2024-09-17T16:24:56.035 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T16:24:56.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T16:24:56.139 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077 branch: wip-bharath10-testing-2024-09-17-1348 description: rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest}} email: skanta@redhat.com first_in_suite: false job_id: '7909077' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath10-testing-2024-09-17-1348 ceph: conf: global: mon election default strategy: 3 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore write v2 random: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath10-testing-2024-09-17-1348 sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - - osd.3 - osd.4 - osd.5 - client.0 seed: 3421 sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath10-testing-2024-09-17-1348 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 targets: smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBke5YS85KnBiq6fRelkZtK5v/qLpF0f/kMxj5C//R6vMzE+6dbQoMx7CknCuSq1gQ1MjvFTTONwdQ2QYSdkt68= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWt8x38Gdr6mIYxp7WuzU8saS0ULgNJdnfN/pZ+TDvARZvCu+iDFPO+dry2W6imkukVRYiXVEmMv38mC4aMFZc= tasks: - install: null - ceph: log-ignorelist: - missing primary copy of - objects unfound and apparently lost - had a read error - overall HEALTH_ - \(POOL_APP_NOT_ENABLED\) - \(PG_DEGRADED\) - \(OSD_TOO_MANY_REPAIRS\) pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - full_sequential: - exec: client.0: - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33 - sudo ceph osd pool create test 16 16 - sudo ceph osd pool set test size 3 - sudo ceph pg dump pgs --format=json-pretty - radosbench: clients: - client.0 create_pool: false objectsize: 1048576 pool: test time: 360 type: rand - exec: client.0: - sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_15:01:33 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T16:24:56.140 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa; will attempt to use it 2024-09-17T16:24:56.140 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa/tasks 2024-09-17T16:24:56.141 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T16:24:56.142 INFO:teuthology.task.internal:Checking packages... 2024-09-17T16:24:56.163 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1889a165b5128787ec693450a3d1c5df5d6dc203' 2024-09-17T16:24:56.163 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T16:24:56.163 INFO:teuthology.packaging:ref: None 2024-09-17T16:24:56.163 INFO:teuthology.packaging:tag: None 2024-09-17T16:24:56.163 INFO:teuthology.packaging:branch: wip-bharath10-testing-2024-09-17-1348 2024-09-17T16:24:56.164 INFO:teuthology.packaging:sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:24:56.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath10-testing-2024-09-17-1348 2024-09-17T16:24:56.318 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4975.g1889a165 2024-09-17T16:24:56.321 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T16:24:56.331 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T16:24:56.331 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T16:24:56.338 INFO:teuthology.task.internal:Saving configuration 2024-09-17T16:24:56.354 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T16:24:56.361 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T16:24:56.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 16:19:41.919692', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBke5YS85KnBiq6fRelkZtK5v/qLpF0f/kMxj5C//R6vMzE+6dbQoMx7CknCuSq1gQ1MjvFTTONwdQ2QYSdkt68='} 2024-09-17T16:24:56.405 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 16:19:41.921519', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWt8x38Gdr6mIYxp7WuzU8saS0ULgNJdnfN/pZ+TDvARZvCu+iDFPO+dry2W6imkukVRYiXVEmMv38mC4aMFZc='} 2024-09-17T16:24:56.405 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T16:24:56.411 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2024-09-17T16:24:56.412 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-09-17T16:24:56.412 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T16:24:56.469 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb78276bbe0>, signals=[15]) 2024-09-17T16:24:56.469 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T16:24:56.474 INFO:teuthology.task.internal:Opening connections... 2024-09-17T16:24:56.474 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:24:56.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:24:56.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:24:56.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:24:56.631 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T16:24:56.638 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-17T16:24:56.656 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-17T16:24:56.656 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-17T16:24:56.713 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-09-17T16:24:56.714 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T16:24:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T16:24:56.715 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T16:24:56.715 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-17T16:24:56.737 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-17T16:24:56.757 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-17T16:24:56.757 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-17T16:24:56.816 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-09-17T16:24:56.816 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-09-17T16:24:56.816 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-09-17T16:24:56.817 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-09-17T16:24:56.817 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T16:24:56.818 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T16:24:56.818 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-17T16:24:56.837 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T16:24:56.847 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T16:24:56.851 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T16:24:56.852 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-17T16:24:56.854 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-17T16:24:56.872 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T16:24:56.879 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T16:24:56.879 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-17T16:24:56.911 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-17T16:24:57.008 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T16:24:57.063 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T16:24:57.080 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T16:24:57.080 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.3': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T16:24:57.080 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T16:24:57.081 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T16:24:57.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:24:57.098 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-17T16:24:57.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:24:57.099 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-17T16:24:57.156 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-503.el9.x86_64 2024-09-17T16:24:57.156 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.14.0-503.el9.x86_64 2024-09-17T16:24:57.156 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel 2024-09-17T16:24:57.157 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-503.el9.x86_64 2024-09-17T16:24:57.158 INFO:teuthology.task.kernel:Running kernel on smithi165: 5.14.0-503.el9.x86_64 2024-09-17T16:24:57.158 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum install -y kernel 2024-09-17T16:24:59.584 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-17T16:25:00.774 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-17T16:25:07.083 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 20 MB 00:05 2024-09-17T16:25:08.592 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-17T16:25:12.858 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-17T16:25:12.992 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-17T16:25:14.468 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-17T16:25:14.791 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-17T16:25:15.255 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-17T16:25:15.654 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-17T16:25:20.660 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-17T16:25:21.118 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T16:25:22.625 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T16:25:22.625 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T16:25:22.710 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:25:22.721 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:25:22.722 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:25:22.722 INFO:teuthology.orchestra.run.smithi165.stdout:Install 4 Packages 2024-09-17T16:25:22.722 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:25:22.722 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 79 M 2024-09-17T16:25:22.722 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 126 M 2024-09-17T16:25:22.722 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:25:23.050 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T16:25:23.050 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T16:25:23.095 INFO:teuthology.orchestra.run.smithi165.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 407 kB/s | 36 kB 00:00 2024-09-17T16:25:23.150 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:25:23.156 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:25:23.156 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout:Install 4 Packages 2024-09-17T16:25:23.157 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:25:23.158 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 79 M 2024-09-17T16:25:23.158 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 126 M 2024-09-17T16:25:23.158 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:25:23.536 INFO:teuthology.orchestra.run.smithi138.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 109 kB/s | 36 kB 00:00 2024-09-17T16:25:23.662 INFO:teuthology.orchestra.run.smithi165.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-17T16:25:24.545 INFO:teuthology.orchestra.run.smithi165.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 22 MB/s | 35 MB 00:01 2024-09-17T16:25:24.965 INFO:teuthology.orchestra.run.smithi165.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 15 MB/s | 29 MB 00:01 2024-09-17T16:25:24.965 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:25:24.965 INFO:teuthology.orchestra.run.smithi165.stdout:Total 35 MB/s | 79 MB 00:02 2024-09-17T16:25:25.643 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:25:25.998 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:25:25.998 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:25:26.977 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:25:26.977 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:25:28.119 INFO:teuthology.orchestra.run.smithi138.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.2 MB/s | 29 MB 00:04 2024-09-17T16:25:29.426 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:25:29.819 INFO:teuthology.orchestra.run.smithi138.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.2 MB/s | 35 MB 00:06 2024-09-17T16:25:30.059 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:25:30.147 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:25:32.904 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:25:33.114 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:25:37.939 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:25:38.063 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:25:41.752 INFO:teuthology.orchestra.run.smithi138.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 865 kB/s | 16 MB 00:18 2024-09-17T16:25:41.752 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:25:41.752 INFO:teuthology.orchestra.run.smithi138.stdout:Total 4.2 MB/s | 79 MB 00:18 2024-09-17T16:25:42.432 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:25:42.797 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:25:42.797 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:25:42.920 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:25:43.744 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:25:43.745 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:25:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:25:46.839 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:25:46.937 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:25:49.696 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:25:49.831 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:25:54.653 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:25:54.689 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:25:59.532 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:21.110 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:21.150 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:21.500 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:21.500 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:26:21.500 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:26:21.500 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:26:22.326 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:26:22.327 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:26:22.683 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:26:22.764 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:26:22.764 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:26:22.765 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T16:26:22.765 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T16:26:22.765 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T16:26:22.765 INFO:teuthology.task.kernel:Installing distro kernel on osd.3... 2024-09-17T16:26:22.765 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T16:26:22.765 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:26:22.824 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:26:22.825 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:26:22.825 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -qi grub2-tools 2024-09-17T16:26:22.864 INFO:teuthology.orchestra.run.smithi165.stdout:Name : grub2-tools 2024-09-17T16:26:22.864 INFO:teuthology.orchestra.run.smithi165.stdout:Epoch : 1 2024-09-17T16:26:22.864 INFO:teuthology.orchestra.run.smithi165.stdout:Version : 2.06 2024-09-17T16:26:22.864 INFO:teuthology.orchestra.run.smithi165.stdout:Release : 82.el9 2024-09-17T16:26:22.864 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: x86_64 2024-09-17T16:26:22.864 INFO:teuthology.orchestra.run.smithi165.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Group : Unspecified 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Size : 8274670 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:License : GPLv3+ 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Packager : builder@centos.org 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Vendor : CentOS 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Summary : Support tools for GRUB. 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout:Description : 2024-09-17T16:26:22.865 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:26:22.866 INFO:teuthology.orchestra.run.smithi165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T16:26:22.866 INFO:teuthology.orchestra.run.smithi165.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T16:26:22.866 INFO:teuthology.orchestra.run.smithi165.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T16:26:22.866 INFO:teuthology.orchestra.run.smithi165.stdout:hardware devices. 2024-09-17T16:26:22.866 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:26:22.866 INFO:teuthology.orchestra.run.smithi165.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T16:26:22.867 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T16:26:22.867 INFO:teuthology.task.kernel:Updating grub on smithi165 to boot 5.14.0-508.el9.x86_64 2024-09-17T16:26:22.867 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T16:26:23.547 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2024-09-17T16:26:24.913 INFO:teuthology.orchestra.run.smithi165.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T16:26:24.938 INFO:teuthology.orchestra.run.smithi165.stderr:done 2024-09-17T16:26:24.945 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2024-09-17T16:26:24.961 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.eBTGd3siDs 2024-09-17T16:26:24.961 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eBTGd3siDs 2024-09-17T16:26:25.033 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.eBTGd3siDs 2024-09-17T16:26:25.183 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.eBTGd3siDs is 6KB 2024-09-17T16:26:25.232 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.eBTGd3siDs 2024-09-17T16:26:25.247 DEBUG:teuthology.orchestra.run.smithi165:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T16:26:25.309 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T16:26:25.310 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T16:26:25.310 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T16:26:25.310 INFO:teuthology.orchestra.run.smithi165.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T16:26:25.311 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T16:26:25.460 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2024-09-17T16:26:37.848 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:37.887 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:38.267 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:38.268 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:26:38.268 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:26:38.268 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:26:39.107 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:26:39.107 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:26:39.107 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:26:39.107 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T16:26:39.108 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T16:26:39.108 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T16:26:39.108 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T16:26:39.108 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:26:39.108 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:26:39.451 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:26:39.534 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:26:39.534 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:26:39.534 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T16:26:39.534 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T16:26:39.534 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T16:26:39.534 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T16:26:39.534 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T16:26:39.535 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:26:39.594 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:26:39.594 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:26:39.594 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -qi grub2-tools 2024-09-17T16:26:39.632 INFO:teuthology.orchestra.run.smithi138.stdout:Name : grub2-tools 2024-09-17T16:26:39.632 INFO:teuthology.orchestra.run.smithi138.stdout:Epoch : 1 2024-09-17T16:26:39.632 INFO:teuthology.orchestra.run.smithi138.stdout:Version : 2.06 2024-09-17T16:26:39.632 INFO:teuthology.orchestra.run.smithi138.stdout:Release : 82.el9 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: x86_64 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Group : Unspecified 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Size : 8274670 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:License : GPLv3+ 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Packager : builder@centos.org 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Vendor : CentOS 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Summary : Support tools for GRUB. 2024-09-17T16:26:39.633 INFO:teuthology.orchestra.run.smithi138.stdout:Description : 2024-09-17T16:26:39.634 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:26:39.634 INFO:teuthology.orchestra.run.smithi138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T16:26:39.634 INFO:teuthology.orchestra.run.smithi138.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T16:26:39.634 INFO:teuthology.orchestra.run.smithi138.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T16:26:39.634 INFO:teuthology.orchestra.run.smithi138.stdout:hardware devices. 2024-09-17T16:26:39.634 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:26:39.634 INFO:teuthology.orchestra.run.smithi138.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T16:26:39.635 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T16:26:39.635 INFO:teuthology.task.kernel:Updating grub on smithi138 to boot 5.14.0-508.el9.x86_64 2024-09-17T16:26:39.635 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T16:26:40.283 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-09-17T16:26:41.624 INFO:teuthology.orchestra.run.smithi138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T16:26:41.656 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-09-17T16:26:41.663 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-17T16:26:41.679 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.zNMaFXZyWS 2024-09-17T16:26:41.679 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zNMaFXZyWS 2024-09-17T16:26:41.746 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.zNMaFXZyWS 2024-09-17T16:26:41.890 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.zNMaFXZyWS is 6KB 2024-09-17T16:26:41.938 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.zNMaFXZyWS 2024-09-17T16:26:41.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T16:26:42.016 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T16:26:42.016 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T16:26:42.017 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T16:26:42.017 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T16:26:42.018 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T16:26:42.172 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-09-17T16:26:55.473 INFO:teuthology.task.kernel:Checking client osd.3 for new kernel version... 2024-09-17T16:26:55.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-17T16:26:55.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:27:12.190 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T16:27:12.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-17T16:27:12.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:27:13.853 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-17T16:27:22.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-17T16:27:22.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:27:25.917 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-17T16:27:30.753 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-17T16:27:37.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-17T16:27:37.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:27:39.755 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-17T16:27:39.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:27:42.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-17T16:27:54.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-17T16:27:54.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:27:56.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2024-09-17T16:28:11.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-17T16:28:11.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:28:11.747 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-17T16:28:12.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-17T16:28:12.081 INFO:teuthology.task.kernel:Checking kernel version of osd.3, want "5.14.0-508.el9.x86_64"... 2024-09-17T16:28:12.082 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2024-09-17T16:28:12.141 INFO:teuthology.orchestra.run.smithi165.stdout:5.14.0-508.el9.x86_64 2024-09-17T16:28:12.141 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T16:28:12.141 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T16:28:12.141 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T16:28:13.143 INFO:teuthology.task.kernel:Enabling kdb on osd.3... 2024-09-17T16:28:13.143 DEBUG:teuthology.orchestra.run.smithi165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T16:28:13.218 INFO:teuthology.orchestra.run.smithi165.stdout:ttyS1 2024-09-17T16:28:13.255 DEBUG:teuthology.parallel:result is None 2024-09-17T16:28:26.676 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-17T16:28:27.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-17T16:28:27.171 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T16:28:27.171 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-17T16:28:27.186 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-508.el9.x86_64 2024-09-17T16:28:27.187 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T16:28:27.187 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T16:28:27.187 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T16:28:28.188 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T16:28:28.188 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T16:28:28.266 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-09-17T16:28:28.287 DEBUG:teuthology.parallel:result is None 2024-09-17T16:28:28.288 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T16:28:28.297 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T16:28:28.297 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T16:28:28.300 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T16:28:28.321 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T16:28:28.327 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T16:28:28.339 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T16:28:28.340 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T16:28:28.355 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T16:28:28.496 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T16:28:28.506 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T16:28:28.506 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T16:28:28.509 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T16:28:28.541 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:28:28.542 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:28:28.551 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:28:28.552 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:28:28.554 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T16:28:28.561 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T16:28:28.561 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T16:28:28.595 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T16:28:28.622 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T16:28:28.631 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T16:28:28.631 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T16:28:28.660 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T16:28:28.679 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:28:28.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:28:28.812 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:28:28.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:28:28.934 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:28:28.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T16:28:28.998 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:28:29.039 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:28:29.095 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:28:29.175 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:28:29.222 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:28:29.222 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T16:28:29.288 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-17T16:28:29.291 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-17T16:28:29.334 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:28:29.382 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:28:29.800 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T16:28:29.808 INFO:teuthology.task.internal:Starting timer... 2024-09-17T16:28:29.809 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T16:28:29.819 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T16:28:29.828 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-09-17T16:28:29.872 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-09-17T16:28:29.874 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-09-17T16:28:29.922 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-09-17T16:28:29.924 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T16:28:29.924 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-09-17T16:28:29.962 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-09-17T16:28:29.962 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-09-17T16:28:30.003 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-09-17T16:28:30.003 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi138.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2024-09-17T16:28:30.004 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:28:30.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:28:30.029 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:28:30.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:28:30.071 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T16:28:30.071 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-09-17T16:28:30.103 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-09-17T16:28:30.141 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T16:28:30.151 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T16:28:30.163 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T16:28:30.164 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T16:32:17.051 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-09-17T16:32:17.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-17T16:32:17.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:17.131 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-17T16:32:17.208 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-17T16:32:17.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-17T16:32:17.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:17.283 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-17T16:32:17.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-17T16:32:17.318 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T16:32:17.328 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T16:32:17.329 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T16:32:17.329 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:32:17.332 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T16:32:17.332 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:32:17.359 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T16:32:17.373 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T16:32:17.388 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T16:32:17.398 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-09-17T16:32:17.401 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T16:32:17.408 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-09-17T16:32:17.422 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T16:32:17.426 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-09-17T16:32:17.436 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T16:32:17.437 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-09-17T16:32:17.451 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T16:32:17.465 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T16:32:17.491 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:32:17.494 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:32:17.494 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-17T16:32:17.494 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.495 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.495 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.495 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.521 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:32:17.526 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:32:17.526 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-17T16:32:17.526 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.526 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.526 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.526 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:32:17.526 INFO:teuthology.run_tasks:Running task install... 2024-09-17T16:32:17.535 DEBUG:teuthology.task.install:project ceph 2024-09-17T16:32:17.535 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}} 2024-09-17T16:32:17.535 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'} 2024-09-17T16:32:17.535 INFO:teuthology.task.install:Using flavor: default 2024-09-17T16:32:17.541 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T16:32:17.542 INFO:teuthology.task.install:extra packages: [] 2024-09-17T16:32:17.542 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'tag': None, 'wait_for_package': False} 2024-09-17T16:32:17.542 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:32:17.544 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'tag': None, 'wait_for_package': False} 2024-09-17T16:32:17.545 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:32:17.697 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/ 2024-09-17T16:32:17.697 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4975.g1889a165 2024-09-17T16:32:17.701 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/ 2024-09-17T16:32:17.701 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4975.g1889a165 2024-09-17T16:32:17.811 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T16:32:17.811 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:32:17.811 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T16:32:17.816 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T16:32:17.816 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:32:17.816 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T16:32:17.837 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T16:32:17.838 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1889a165b5128787ec693450a3d1c5df5d6dc203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T16:32:17.842 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T16:32:17.842 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1889a165b5128787ec693450a3d1c5df5d6dc203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T16:32:17.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T16:32:17.909 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T16:32:17.981 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T16:32:17.983 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T16:32:18.045 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-09-17T16:32:18.047 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-09-17T16:32:18.048 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-09-17T16:32:18.050 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-09-17T16:32:18.275 INFO:teuthology.orchestra.run.smithi138.stdout:45 files removed 2024-09-17T16:32:18.280 INFO:teuthology.orchestra.run.smithi165.stdout:45 files removed 2024-09-17T16:32:18.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw 2024-09-17T16:32:18.308 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw 2024-09-17T16:32:18.860 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-17T16:32:18.881 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 296 kB/s | 84 kB 00:00 2024-09-17T16:32:19.152 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-17T16:32:19.173 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-17T16:32:19.436 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-17T16:32:19.449 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-17T16:32:20.157 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-17T16:32:21.478 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.3 MB 00:02 2024-09-17T16:32:25.100 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-17T16:32:25.654 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-17T16:32:30.809 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-17T16:32:31.064 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-17T16:32:32.384 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-17T16:32:32.848 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-17T16:32:33.305 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-17T16:32:33.769 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-17T16:32:38.720 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T16:32:39.142 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T16:32:40.946 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:32:40.957 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:32:40.958 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:32:40.958 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:32:40.958 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:32:40.958 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 11 M 2024-09-17T16:32:40.958 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-09-17T16:32:40.958 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.5 M 2024-09-17T16:32:40.958 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.3 M 2024-09-17T16:32:40.959 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:32:40.959 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T16:32:40.959 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:32:40.959 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 22 M 2024-09-17T16:32:40.959 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.3.0-4975.g1889a165.el9 ceph 25 k 2024-09-17T16:32:40.959 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T16:32:40.960 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T16:32:40.960 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T16:32:40.960 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 756 k 2024-09-17T16:32:40.960 INFO:teuthology.orchestra.run.smithi165.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 508 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 45 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 143 k 2024-09-17T16:32:40.961 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.3.0-4975.g1889a165.el9 ceph 161 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.3.0-4975.g1889a165.el9 ceph 321 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 305 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 99 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:32:40.962 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:32:40.963 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:32:40.963 INFO:teuthology.orchestra.run.smithi165.stdout:Install 31 Packages 2024-09-17T16:32:40.963 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 2 Packages 2024-09-17T16:32:40.963 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:32:40.963 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 62 M 2024-09-17T16:32:40.963 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 11 M 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.5 M 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.3 M 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 22 M 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:19.3.0-4975.g1889a165.el9 ceph 25 k 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T16:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 756 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 508 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T16:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 45 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 143 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:19.3.0-4975.g1889a165.el9 ceph 161 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:19.3.0-4975.g1889a165.el9 ceph 321 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 305 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 99 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T16:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout:Install 31 Packages 2024-09-17T16:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 2 Packages 2024-09-17T16:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 62 M 2024-09-17T16:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:32:42.385 INFO:teuthology.orchestra.run.smithi138.stdout:(1/33): ceph-base-19.3.0-4975.g1889a165.el9.x86 6.9 MB/s | 5.5 MB 00:00 2024-09-17T16:32:42.427 INFO:teuthology.orchestra.run.smithi138.stdout:(2/33): ceph-selinux-19.3.0-4975.g1889a165.el9. 608 kB/s | 25 kB 00:00 2024-09-17T16:32:42.511 INFO:teuthology.orchestra.run.smithi138.stdout:(3/33): libcephfs2-19.3.0-4975.g1889a165.el9.x8 8.8 MB/s | 756 kB 00:00 2024-09-17T16:32:42.512 INFO:teuthology.orchestra.run.smithi165.stdout:(1/33): ceph-base-19.3.0-4975.g1889a165.el9.x86 5.9 MB/s | 5.5 MB 00:00 2024-09-17T16:32:42.579 INFO:teuthology.orchestra.run.smithi165.stdout:(2/33): ceph-selinux-19.3.0-4975.g1889a165.el9. 378 kB/s | 25 kB 00:00 2024-09-17T16:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout:(4/33): libradosstriper1-19.3.0-4975.g1889a165. 5.0 MB/s | 508 kB 00:00 2024-09-17T16:32:42.712 INFO:teuthology.orchestra.run.smithi165.stdout:(3/33): libcephfs2-19.3.0-4975.g1889a165.el9.x8 5.5 MB/s | 756 kB 00:00 2024-09-17T16:32:42.855 INFO:teuthology.orchestra.run.smithi165.stdout:(4/33): libradosstriper1-19.3.0-4975.g1889a165. 3.5 MB/s | 508 kB 00:00 2024-09-17T16:32:42.970 INFO:teuthology.orchestra.run.smithi138.stdout:(5/33): ceph-radosgw-19.3.0-4975.g1889a165.el9. 7.9 MB/s | 11 MB 00:01 2024-09-17T16:32:42.980 INFO:teuthology.orchestra.run.smithi165.stdout:(5/33): ceph-radosgw-19.3.0-4975.g1889a165.el9. 7.7 MB/s | 11 MB 00:01 2024-09-17T16:32:43.046 INFO:teuthology.orchestra.run.smithi138.stdout:(6/33): python3-ceph-argparse-19.3.0-4975.g1889 602 kB/s | 45 kB 00:00 2024-09-17T16:32:43.047 INFO:teuthology.orchestra.run.smithi165.stdout:(6/33): python3-ceph-argparse-19.3.0-4975.g1889 678 kB/s | 45 kB 00:00 2024-09-17T16:32:43.129 INFO:teuthology.orchestra.run.smithi138.stdout:(7/33): python3-ceph-common-19.3.0-4975.g1889a1 1.7 MB/s | 143 kB 00:00 2024-09-17T16:32:43.130 INFO:teuthology.orchestra.run.smithi165.stdout:(7/33): python3-ceph-common-19.3.0-4975.g1889a1 1.7 MB/s | 143 kB 00:00 2024-09-17T16:32:43.204 INFO:teuthology.orchestra.run.smithi138.stdout:(8/33): librgw2-19.3.0-4975.g1889a165.el9.x86_6 9.3 MB/s | 5.5 MB 00:00 2024-09-17T16:32:43.205 INFO:teuthology.orchestra.run.smithi165.stdout:(8/33): python3-cephfs-19.3.0-4975.g1889a165.el 2.1 MB/s | 161 kB 00:00 2024-09-17T16:32:43.229 INFO:teuthology.orchestra.run.smithi138.stdout:(9/33): python3-cephfs-19.3.0-4975.g1889a165.el 1.6 MB/s | 161 kB 00:00 2024-09-17T16:32:43.271 INFO:teuthology.orchestra.run.smithi138.stdout:(10/33): python3-rados-19.3.0-4975.g1889a165.el 4.7 MB/s | 321 kB 00:00 2024-09-17T16:32:43.289 INFO:teuthology.orchestra.run.smithi165.stdout:(9/33): python3-rados-19.3.0-4975.g1889a165.el9 3.8 MB/s | 321 kB 00:00 2024-09-17T16:32:43.322 INFO:teuthology.orchestra.run.smithi138.stdout:(11/33): python3-rbd-19.3.0-4975.g1889a165.el9. 3.2 MB/s | 305 kB 00:00 2024-09-17T16:32:43.347 INFO:teuthology.orchestra.run.smithi138.stdout:(12/33): python3-rgw-19.3.0-4975.g1889a165.el9. 1.3 MB/s | 99 kB 00:00 2024-09-17T16:32:43.381 INFO:teuthology.orchestra.run.smithi165.stdout:(10/33): python3-rbd-19.3.0-4975.g1889a165.el9. 3.3 MB/s | 305 kB 00:00 2024-09-17T16:32:43.481 INFO:teuthology.orchestra.run.smithi165.stdout:(11/33): librgw2-19.3.0-4975.g1889a165.el9.x86_ 8.8 MB/s | 5.5 MB 00:00 2024-09-17T16:32:43.506 INFO:teuthology.orchestra.run.smithi165.stdout:(12/33): python3-rgw-19.3.0-4975.g1889a165.el9. 792 kB/s | 99 kB 00:00 2024-09-17T16:32:43.581 INFO:teuthology.orchestra.run.smithi138.stdout:(13/33): ceph-common-19.3.0-4975.g1889a165.el9. 11 MB/s | 22 MB 00:01 2024-09-17T16:32:43.707 INFO:teuthology.orchestra.run.smithi165.stdout:(13/33): ceph-common-19.3.0-4975.g1889a165.el9. 10 MB/s | 22 MB 00:02 2024-09-17T16:32:43.891 INFO:teuthology.orchestra.run.smithi165.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 261 kB/s | 107 kB 00:00 2024-09-17T16:32:43.941 INFO:teuthology.orchestra.run.smithi165.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 393 kB/s | 171 kB 00:00 2024-09-17T16:32:43.956 INFO:teuthology.orchestra.run.smithi138.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 169 kB/s | 107 kB 00:00 2024-09-17T16:32:43.958 INFO:teuthology.orchestra.run.smithi165.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 684 kB/s | 45 kB 00:00 2024-09-17T16:32:43.983 INFO:teuthology.orchestra.run.smithi165.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 581 kB/s | 160 kB 00:00 2024-09-17T16:32:44.040 INFO:teuthology.orchestra.run.smithi138.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 246 kB/s | 171 kB 00:00 2024-09-17T16:32:44.042 INFO:teuthology.orchestra.run.smithi165.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 722 kB/s | 42 kB 00:00 2024-09-17T16:32:44.065 INFO:teuthology.orchestra.run.smithi138.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-17T16:32:44.067 INFO:teuthology.orchestra.run.smithi165.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 662 kB 00:00 2024-09-17T16:32:44.101 INFO:teuthology.orchestra.run.smithi165.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-17T16:32:44.124 INFO:teuthology.orchestra.run.smithi138.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 295 kB/s | 160 kB 00:00 2024-09-17T16:32:44.126 INFO:teuthology.orchestra.run.smithi165.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 612 kB/s | 36 kB 00:00 2024-09-17T16:32:44.160 INFO:teuthology.orchestra.run.smithi165.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-17T16:32:44.185 INFO:teuthology.orchestra.run.smithi165.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-17T16:32:44.227 INFO:teuthology.orchestra.run.smithi165.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-17T16:32:44.241 INFO:teuthology.orchestra.run.smithi138.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 362 kB/s | 42 kB 00:00 2024-09-17T16:32:44.252 INFO:teuthology.orchestra.run.smithi165.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-17T16:32:44.277 INFO:teuthology.orchestra.run.smithi165.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 306 kB/s | 26 kB 00:00 2024-09-17T16:32:44.303 INFO:teuthology.orchestra.run.smithi165.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T16:32:44.328 INFO:teuthology.orchestra.run.smithi165.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-17T16:32:44.358 INFO:teuthology.orchestra.run.smithi138.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-09-17T16:32:44.387 INFO:teuthology.orchestra.run.smithi165.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-17T16:32:44.437 INFO:teuthology.orchestra.run.smithi165.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-17T16:32:44.449 INFO:teuthology.orchestra.run.smithi138.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 1.6 MB/s | 662 kB 00:00 2024-09-17T16:32:44.475 INFO:teuthology.orchestra.run.smithi138.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 307 kB/s | 36 kB 00:00 2024-09-17T16:32:44.521 INFO:teuthology.orchestra.run.smithi165.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-17T16:32:44.550 INFO:teuthology.orchestra.run.smithi138.stdout:(22/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-17T16:32:44.576 INFO:teuthology.orchestra.run.smithi138.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 659 kB/s | 221 kB 00:00 2024-09-17T16:32:44.609 INFO:teuthology.orchestra.run.smithi138.stdout:(24/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 297 kB/s | 47 kB 00:00 2024-09-17T16:32:44.668 INFO:teuthology.orchestra.run.smithi138.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 282 kB/s | 26 kB 00:00 2024-09-17T16:32:44.688 INFO:teuthology.orchestra.run.smithi165.stdout:(32/33): librados2-19.3.0-4975.g1889a165.el9.x8 12 MB/s | 3.5 MB 00:00 2024-09-17T16:32:44.702 INFO:teuthology.orchestra.run.smithi138.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-09-17T16:32:44.727 INFO:teuthology.orchestra.run.smithi138.stdout:(27/33): liboath-2.6.7-2.el9.x86_64.rpm 441 kB/s | 49 kB 00:00 2024-09-17T16:32:44.738 INFO:teuthology.orchestra.run.smithi165.stdout:(33/33): librbd1-19.3.0-4975.g1889a165.el9.x86_ 11 MB/s | 3.3 MB 00:00 2024-09-17T16:32:44.742 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:32:44.743 INFO:teuthology.orchestra.run.smithi165.stdout:Total 16 MB/s | 62 MB 00:03 2024-09-17T16:32:44.761 INFO:teuthology.orchestra.run.smithi138.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T16:32:44.820 INFO:teuthology.orchestra.run.smithi138.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-17T16:32:44.853 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:32:44.887 INFO:teuthology.orchestra.run.smithi138.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-17T16:32:44.890 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:32:44.890 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:32:44.937 INFO:teuthology.orchestra.run.smithi138.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-17T16:32:45.146 INFO:teuthology.orchestra.run.smithi138.stdout:(32/33): librbd1-19.3.0-4975.g1889a165.el9.x86_ 13 MB/s | 3.3 MB 00:00 2024-09-17T16:32:45.204 INFO:teuthology.orchestra.run.smithi138.stdout:(33/33): librados2-19.3.0-4975.g1889a165.el9.x8 9.0 MB/s | 3.5 MB 00:00 2024-09-17T16:32:45.209 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:32:45.210 INFO:teuthology.orchestra.run.smithi138.stdout:Total 16 MB/s | 62 MB 00:03 2024-09-17T16:32:45.321 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:32:45.359 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:32:45.359 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:32:45.562 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:32:45.563 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:32:46.036 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:32:46.036 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:32:47.076 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:32:47.147 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-17T16:32:47.176 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-17T16:32:47.201 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-17T16:32:47.224 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:32:47.246 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:32:47.451 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:32:47.505 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:32:47.552 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:32:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-17T16:32:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-17T16:32:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-17T16:32:47.724 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:32:47.745 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:32:47.888 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-17T16:32:47.919 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:32:47.945 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:32:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:32:48.020 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:32:48.111 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 8/35 2024-09-17T16:32:48.138 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:32:48.200 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:32:48.237 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-17T16:32:48.273 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 11/35 2024-09-17T16:32:48.339 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-17T16:32:48.358 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:32:48.382 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:32:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:32:48.446 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:32:48.480 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-17T16:32:48.536 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:32:48.589 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-17T16:32:48.624 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-17T16:32:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 8/35 2024-09-17T16:32:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:32:48.670 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-17T16:32:48.697 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-17T16:32:48.710 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:32:48.717 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-17T16:32:48.739 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-17T16:32:48.751 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:32:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 11/35 2024-09-17T16:32:48.788 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-17T16:32:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:32:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:32:48.948 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:32:48.982 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-17T16:32:49.100 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-17T16:32:49.122 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-17T16:32:49.157 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-17T16:32:49.164 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:32:49.204 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-17T16:32:49.233 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-17T16:32:49.256 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:32:49.262 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-17T16:32:49.286 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 24/35 2024-09-17T16:32:49.295 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:32:49.331 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-17T16:32:49.332 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-17T16:32:49.651 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-17T16:32:49.692 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:32:49.774 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:32:49.806 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 24/35 2024-09-17T16:32:49.842 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-17T16:32:49.852 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-17T16:32:49.875 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:32:49.947 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:32:50.034 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 28/35 2024-09-17T16:32:50.290 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 29/35 2024-09-17T16:32:50.335 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-17T16:32:50.363 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:32:50.426 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:32:50.503 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 28/35 2024-09-17T16:32:50.540 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 29/35 2024-09-17T16:32:52.349 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:32:52.382 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:32:52.833 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:32:52.879 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:32:52.955 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:32:52.995 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:32:53.069 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:32:53.069 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T16:32:53.069 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T16:32:53.070 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:32:53.104 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:32:53.444 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:32:53.483 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:32:53.581 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:32:53.581 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T16:32:53.581 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T16:32:53.581 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:32:53.610 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:33:02.855 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:33:02.855 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-09-17T16:33:02.855 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-09-17T16:33:02.855 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-09-17T16:33:02.855 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-09-17T16:33:02.856 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-09-17T16:33:02.856 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-09-17T16:33:02.856 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-09-17T16:33:02.856 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:03.477 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:33:03.477 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-09-17T16:33:03.478 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-09-17T16:33:03.478 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-09-17T16:33:03.478 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-09-17T16:33:03.478 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-09-17T16:33:03.478 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-09-17T16:33:03.478 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-09-17T16:33:03.478 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:03.877 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:33:03.902 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:33:03.903 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:03.903 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T16:33:03.903 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:33:03.903 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:33:03.903 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:03.904 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:33:03.996 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:33:03.996 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:33:04.489 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:33:04.514 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:33:04.514 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:04.514 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T16:33:04.514 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:33:04.514 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:33:04.514 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:04.516 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:33:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:33:04.608 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:33:05.189 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:33:05.189 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 1/35 2024-09-17T16:33:05.189 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2/35 2024-09-17T16:33:05.189 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 3/35 2024-09-17T16:33:05.189 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 4/35 2024-09-17T16:33:05.189 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 5/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 6/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 8/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 9/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 10/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 11/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 13/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-17T16:33:05.190 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-17T16:33:05.191 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-17T16:33:05.192 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-17T16:33:05.192 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-17T16:33:05.192 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:33:05.192 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-17T16:33:05.192 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 34/35 2024-09-17T16:33:05.904 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:33:05.904 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 1/35 2024-09-17T16:33:05.904 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2/35 2024-09-17T16:33:05.904 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 3/35 2024-09-17T16:33:05.904 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 4/35 2024-09-17T16:33:05.904 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 5/35 2024-09-17T16:33:05.904 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 6/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 8/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 9/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 10/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 11/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 13/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-17T16:33:05.905 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-17T16:33:05.906 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-17T16:33:05.907 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 34/35 2024-09-17T16:33:06.187 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:33:06.187 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:06.187 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-09-17T16:33:06.187 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.187 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.187 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:33:06.187 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T16:33:06.188 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T16:33:06.189 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:06.190 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:06.543 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-test 2024-09-17T16:33:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:33:07.056 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:07.056 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.057 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T16:33:07.058 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:07.059 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:07.127 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:07.268 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.3.0-4975.g1889a165.el9 ceph 46 M 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.3.0-4975.g1889a165.el9 ceph 162 k 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:07.269 INFO:teuthology.orchestra.run.smithi165.stdout:Install 4 Packages 2024-09-17T16:33:07.270 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:07.270 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 46 M 2024-09-17T16:33:07.270 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 201 M 2024-09-17T16:33:07.270 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:33:07.396 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-test 2024-09-17T16:33:07.494 INFO:teuthology.orchestra.run.smithi165.stdout:(1/4): libcephsqlite-19.3.0-4975.g1889a165.el9. 821 kB/s | 162 kB 00:00 2024-09-17T16:33:07.536 INFO:teuthology.orchestra.run.smithi165.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-17T16:33:07.661 INFO:teuthology.orchestra.run.smithi165.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 382 kB/s | 64 kB 00:00 2024-09-17T16:33:07.970 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:08.101 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:08.101 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:08.101 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:33:08.101 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:19.3.0-4975.g1889a165.el9 ceph 46 M 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:19.3.0-4975.g1889a165.el9 ceph 162 k 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout:Install 4 Packages 2024-09-17T16:33:08.102 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:08.103 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 46 M 2024-09-17T16:33:08.103 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 201 M 2024-09-17T16:33:08.103 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:33:08.483 INFO:teuthology.orchestra.run.smithi138.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-17T16:33:08.516 INFO:teuthology.orchestra.run.smithi138.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-17T16:33:08.583 INFO:teuthology.orchestra.run.smithi138.stdout:(3/4): libcephsqlite-19.3.0-4975.g1889a165.el9. 719 kB/s | 162 kB 00:00 2024-09-17T16:33:08.695 INFO:teuthology.orchestra.run.smithi165.stdout:(4/4): ceph-test-19.3.0-4975.g1889a165.el9.x86_ 33 MB/s | 46 MB 00:01 2024-09-17T16:33:08.697 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:08.697 INFO:teuthology.orchestra.run.smithi165.stdout:Total 32 MB/s | 46 MB 00:01 2024-09-17T16:33:08.726 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:33:08.747 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:33:08.747 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:33:09.109 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:33:09.109 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:33:09.610 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:33:09.690 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T16:33:09.739 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T16:33:09.763 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:33:09.792 INFO:teuthology.orchestra.run.smithi138.stdout:(4/4): ceph-test-19.3.0-4975.g1889a165.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-17T16:33:09.794 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:09.794 INFO:teuthology.orchestra.run.smithi138.stdout:Total 27 MB/s | 46 MB 00:01 2024-09-17T16:33:09.822 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:33:09.842 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:33:09.842 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:33:10.208 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:33:10.209 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:33:10.717 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:33:10.793 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T16:33:10.840 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T16:33:10.869 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:33:14.157 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:33:14.237 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:33:15.221 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:33:15.310 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:33:16.484 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:33:16.484 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 1/4 2024-09-17T16:33:16.484 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2/4 2024-09-17T16:33:16.484 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T16:33:16.809 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T16:33:16.809 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:16.809 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:33:16.809 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:16.810 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:16.810 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T16:33:16.810 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T16:33:16.810 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:16.810 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:17.108 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph 2024-09-17T16:33:17.723 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:33:17.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 1/4 2024-09-17T16:33:17.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2/4 2024-09-17T16:33:17.723 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T16:33:17.725 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:17.869 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.3.0-4975.g1889a165.el9 ceph 6.6 k 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.3.0-4975.g1889a165.el9 ceph 2.4 M 2024-09-17T16:33:17.871 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.3.0-4975.g1889a165.el9 ceph 1.5 M 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 291 k 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.3.0-4975.g1889a165.el9 ceph 4.8 M 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 17 M 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T16:33:17.872 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T16:33:17.873 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T16:33:17.874 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout:Install 37 Packages 2024-09-17T16:33:17.875 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:17.876 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 31 M 2024-09-17T16:33:17.876 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 109 M 2024-09-17T16:33:17.876 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T16:33:18.067 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:18.068 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:18.247 INFO:teuthology.orchestra.run.smithi165.stdout:(1/37): ceph-19.3.0-4975.g1889a165.el9.x86_64.r 46 kB/s | 6.6 kB 00:00 2024-09-17T16:33:18.360 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph 2024-09-17T16:33:18.414 INFO:teuthology.orchestra.run.smithi165.stdout:(2/37): ceph-mgr-19.3.0-4975.g1889a165.el9.x86_ 4.9 MB/s | 1.5 MB 00:00 2024-09-17T16:33:18.464 INFO:teuthology.orchestra.run.smithi165.stdout:(3/37): ceph-mds-19.3.0-4975.g1889a165.el9.x86_ 6.6 MB/s | 2.4 MB 00:00 2024-09-17T16:33:18.548 INFO:teuthology.orchestra.run.smithi165.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4975.g1889 3.4 MB/s | 291 kB 00:00 2024-09-17T16:33:18.682 INFO:teuthology.orchestra.run.smithi165.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 253 kB 00:00 2024-09-17T16:33:18.774 INFO:teuthology.orchestra.run.smithi165.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-17T16:33:18.841 INFO:teuthology.orchestra.run.smithi165.stdout:(7/37): ceph-mon-19.3.0-4975.g1889a165.el9.x86_ 8.1 MB/s | 4.8 MB 00:00 2024-09-17T16:33:18.866 INFO:teuthology.orchestra.run.smithi165.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-17T16:33:18.963 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:19.041 INFO:teuthology.orchestra.run.smithi165.stdout:(9/37): ceph-osd-19.3.0-4975.g1889a165.el9.x86_ 27 MB/s | 17 MB 00:00 2024-09-17T16:33:19.066 INFO:teuthology.orchestra.run.smithi165.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 623 kB/s | 125 kB 00:00 2024-09-17T16:33:19.098 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:19.100 INFO:teuthology.orchestra.run.smithi165.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 522 kB/s | 135 kB 00:00 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:19.3.0-4975.g1889a165.el9 ceph 6.6 k 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:19.3.0-4975.g1889a165.el9 ceph 2.4 M 2024-09-17T16:33:19.101 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:19.3.0-4975.g1889a165.el9 ceph 1.5 M 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 291 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:19.3.0-4975.g1889a165.el9 ceph 4.8 M 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 17 M 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T16:33:19.102 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T16:33:19.103 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:19.104 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:33:19.105 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:19.105 INFO:teuthology.orchestra.run.smithi138.stdout:Install 37 Packages 2024-09-17T16:33:19.105 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:19.105 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 31 M 2024-09-17T16:33:19.105 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 109 M 2024-09-17T16:33:19.105 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:33:19.200 INFO:teuthology.orchestra.run.smithi165.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.3 MB/s | 215 kB 00:00 2024-09-17T16:33:19.259 INFO:teuthology.orchestra.run.smithi165.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 980 kB/s | 188 kB 00:00 2024-09-17T16:33:19.284 INFO:teuthology.orchestra.run.smithi165.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 936 kB/s | 172 kB 00:00 2024-09-17T16:33:19.301 INFO:teuthology.orchestra.run.smithi165.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 345 kB/s | 35 kB 00:00 2024-09-17T16:33:19.326 INFO:teuthology.orchestra.run.smithi165.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.1 MB/s | 77 kB 00:00 2024-09-17T16:33:19.360 INFO:teuthology.orchestra.run.smithi165.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-17T16:33:19.385 INFO:teuthology.orchestra.run.smithi165.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2024-09-17T16:33:19.427 INFO:teuthology.orchestra.run.smithi165.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-17T16:33:19.461 INFO:teuthology.orchestra.run.smithi165.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 5.3 MB/s | 172 kB 00:00 2024-09-17T16:33:19.486 INFO:teuthology.orchestra.run.smithi165.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 140 kB/s | 22 kB 00:00 2024-09-17T16:33:19.520 INFO:teuthology.orchestra.run.smithi165.stdout:(22/37): luarocks-3.9.2-5.el9.noarch.rpm 949 kB/s | 151 kB 00:00 2024-09-17T16:33:19.545 INFO:teuthology.orchestra.run.smithi165.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 756 kB/s | 18 kB 00:00 2024-09-17T16:33:19.570 INFO:teuthology.orchestra.run.smithi165.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 127 kB/s | 11 kB 00:00 2024-09-17T16:33:19.596 INFO:teuthology.orchestra.run.smithi165.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-17T16:33:19.621 INFO:teuthology.orchestra.run.smithi165.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-17T16:33:19.646 INFO:teuthology.orchestra.run.smithi165.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-17T16:33:19.672 INFO:teuthology.orchestra.run.smithi165.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-17T16:33:19.697 INFO:teuthology.orchestra.run.smithi165.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-17T16:33:19.722 INFO:teuthology.orchestra.run.smithi165.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-17T16:33:19.747 INFO:teuthology.orchestra.run.smithi165.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-17T16:33:19.773 INFO:teuthology.orchestra.run.smithi165.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-17T16:33:19.798 INFO:teuthology.orchestra.run.smithi165.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-17T16:33:19.823 INFO:teuthology.orchestra.run.smithi165.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-17T16:33:19.852 INFO:teuthology.orchestra.run.smithi165.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.8 MB/s | 230 kB 00:00 2024-09-17T16:33:19.869 INFO:teuthology.orchestra.run.smithi165.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 441 kB/s | 20 kB 00:00 2024-09-17T16:33:19.895 INFO:teuthology.orchestra.run.smithi165.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.3 MB/s | 427 kB 00:00 2024-09-17T16:33:19.898 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:19.898 INFO:teuthology.orchestra.run.smithi165.stdout:Total 15 MB/s | 31 MB 00:02 2024-09-17T16:33:19.999 INFO:teuthology.orchestra.run.smithi138.stdout:(1/37): ceph-19.3.0-4975.g1889a165.el9.x86_64.r 56 kB/s | 6.6 kB 00:00 2024-09-17T16:33:20.046 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:33:20.086 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:33:20.086 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:33:20.216 INFO:teuthology.orchestra.run.smithi138.stdout:(2/37): ceph-mds-19.3.0-4975.g1889a165.el9.x86_ 7.1 MB/s | 2.4 MB 00:00 2024-09-17T16:33:20.257 INFO:teuthology.orchestra.run.smithi138.stdout:(3/37): ceph-mgr-19.3.0-4975.g1889a165.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-09-17T16:33:20.358 INFO:teuthology.orchestra.run.smithi138.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4975.g1889 2.8 MB/s | 291 kB 00:00 2024-09-17T16:33:20.450 INFO:teuthology.orchestra.run.smithi138.stdout:(5/37): ceph-mon-19.3.0-4975.g1889a165.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-17T16:33:20.558 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:33:20.558 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:33:20.626 INFO:teuthology.orchestra.run.smithi138.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 949 kB/s | 253 kB 00:00 2024-09-17T16:33:20.801 INFO:teuthology.orchestra.run.smithi138.stdout:(7/37): ceph-osd-19.3.0-4975.g1889a165.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-17T16:33:20.826 INFO:teuthology.orchestra.run.smithi138.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 531 kB/s | 106 kB 00:00 2024-09-17T16:33:20.893 INFO:teuthology.orchestra.run.smithi138.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 2.8 MB/s | 1.2 MB 00:00 2024-09-17T16:33:20.918 INFO:teuthology.orchestra.run.smithi138.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 125 kB 00:00 2024-09-17T16:33:20.952 INFO:teuthology.orchestra.run.smithi138.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-17T16:33:21.028 INFO:teuthology.orchestra.run.smithi138.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 598 kB/s | 135 kB 00:00 2024-09-17T16:33:21.189 INFO:teuthology.orchestra.run.smithi138.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-17T16:33:21.189 INFO:teuthology.orchestra.run.smithi138.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-17T16:33:21.189 INFO:teuthology.orchestra.run.smithi138.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-17T16:33:21.189 INFO:teuthology.orchestra.run.smithi138.stdout:(16/37): python3-markupsafe-1.1.1-12.el9.x86_64 412 kB/s | 35 kB 00:00 2024-09-17T16:33:21.189 INFO:teuthology.orchestra.run.smithi138.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 865 kB/s | 51 kB 00:00 2024-09-17T16:33:21.189 INFO:teuthology.orchestra.run.smithi138.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 618 kB/s | 42 kB 00:00 2024-09-17T16:33:21.205 INFO:teuthology.orchestra.run.smithi138.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-17T16:33:21.231 INFO:teuthology.orchestra.run.smithi138.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 189 kB/s | 22 kB 00:00 2024-09-17T16:33:21.256 INFO:teuthology.orchestra.run.smithi138.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-17T16:33:21.290 INFO:teuthology.orchestra.run.smithi138.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-17T16:33:21.315 INFO:teuthology.orchestra.run.smithi138.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 207 kB/s | 11 kB 00:00 2024-09-17T16:33:21.340 INFO:teuthology.orchestra.run.smithi138.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 365 kB/s | 18 kB 00:00 2024-09-17T16:33:21.365 INFO:teuthology.orchestra.run.smithi138.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-17T16:33:21.391 INFO:teuthology.orchestra.run.smithi138.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 385 kB/s | 19 kB 00:00 2024-09-17T16:33:21.416 INFO:teuthology.orchestra.run.smithi138.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-17T16:33:21.463 INFO:teuthology.orchestra.run.smithi138.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 649 kB/s | 46 kB 00:00 2024-09-17T16:33:21.488 INFO:teuthology.orchestra.run.smithi138.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-17T16:33:21.513 INFO:teuthology.orchestra.run.smithi138.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-17T16:33:21.530 INFO:teuthology.orchestra.run.smithi138.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 392 kB/s | 16 kB 00:00 2024-09-17T16:33:21.556 INFO:teuthology.orchestra.run.smithi138.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-17T16:33:21.581 INFO:teuthology.orchestra.run.smithi138.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-17T16:33:21.606 INFO:teuthology.orchestra.run.smithi138.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 472 kB/s | 36 kB 00:00 2024-09-17T16:33:21.632 INFO:teuthology.orchestra.run.smithi138.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 798 kB/s | 20 kB 00:00 2024-09-17T16:33:21.665 INFO:teuthology.orchestra.run.smithi138.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-17T16:33:21.690 INFO:teuthology.orchestra.run.smithi138.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-17T16:33:21.694 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:21.694 INFO:teuthology.orchestra.run.smithi138.stdout:Total 12 MB/s | 31 MB 00:02 2024-09-17T16:33:21.846 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:33:21.886 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:33:21.886 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:33:21.931 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:33:21.982 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T16:33:22.014 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T16:33:22.041 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T16:33:22.112 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T16:33:22.158 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T16:33:22.190 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T16:33:22.286 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T16:33:22.340 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:33:22.341 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:33:22.369 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T16:33:22.410 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T16:33:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T16:33:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T16:33:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T16:33:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T16:33:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T16:33:22.618 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T16:33:22.652 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T16:33:22.701 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T16:33:22.734 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T16:33:22.815 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T16:33:22.955 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T16:33:23.032 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T16:33:23.086 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T16:33:23.125 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T16:33:23.185 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T16:33:23.237 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T16:33:23.429 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T16:33:23.476 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T16:33:23.554 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T16:33:23.643 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T16:33:23.682 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:33:23.684 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T16:33:23.752 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T16:33:23.796 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T16:33:23.811 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T16:33:23.830 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T16:33:23.900 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T16:33:23.954 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T16:33:23.973 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 32/37 2024-09-17T16:33:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T16:33:24.004 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:33:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:33:24.030 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:24.030 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T16:33:24.030 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:33:24.030 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:33:24.030 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T16:33:24.156 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T16:33:24.198 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T16:33:24.233 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T16:33:24.263 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T16:33:24.298 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T16:33:24.332 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T16:33:24.373 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T16:33:24.408 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T16:33:24.442 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T16:33:24.491 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T16:33:24.523 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T16:33:24.595 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T16:33:24.734 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T16:33:24.807 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T16:33:24.860 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T16:33:24.905 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T16:33:24.954 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T16:33:25.009 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T16:33:25.194 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T16:33:25.252 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T16:33:25.329 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T16:33:25.418 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T16:33:25.451 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T16:33:25.487 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:33:25.514 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:33:25.515 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:25.515 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T16:33:25.515 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:33:25.515 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:33:25.515 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:25.595 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T16:33:25.749 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 32/37 2024-09-17T16:33:25.779 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:33:25.805 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:33:25.805 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:25.805 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T16:33:25.806 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:33:25.806 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:33:25.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:25.971 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:33:25.995 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:33:25.995 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:25.996 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T16:33:25.996 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:33:25.996 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:33:25.996 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:26.222 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:33:26.245 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:33:26.246 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:26.246 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T16:33:26.246 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:33:26.246 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:33:26.246 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:26.311 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:33:27.264 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:33:27.291 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:33:27.291 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:27.291 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T16:33:27.292 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:33:27.292 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:33:27.292 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:27.748 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:33:27.772 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:33:27.772 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:27.772 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T16:33:27.772 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:33:27.772 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:33:27.773 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:27.999 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:33:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:33:28.022 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:28.022 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T16:33:28.022 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:33:28.022 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:33:28.022 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:28.059 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:33:28.059 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 1/37 2024-09-17T16:33:28.059 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2/37 2024-09-17T16:33:28.059 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 3/37 2024-09-17T16:33:28.059 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 4/37 2024-09-17T16:33:28.059 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 5/37 2024-09-17T16:33:28.059 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 6/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T16:33:28.060 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T16:33:28.061 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T16:33:28.062 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T16:33:28.062 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T16:33:28.062 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T16:33:28.063 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T16:33:28.063 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T16:33:28.063 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T16:33:28.063 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T16:33:28.063 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T16:33:28.063 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T16:33:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:33:29.066 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T16:33:29.066 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:29.066 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:33:29.066 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:29.066 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:29.066 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:29.066 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T16:33:29.067 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T16:33:29.068 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:29.069 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:29.447 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-base 2024-09-17T16:33:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:33:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 1/37 2024-09-17T16:33:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2/37 2024-09-17T16:33:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 3/37 2024-09-17T16:33:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 4/37 2024-09-17T16:33:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 5/37 2024-09-17T16:33:29.944 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 6/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T16:33:29.945 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T16:33:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T16:33:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T16:33:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T16:33:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T16:33:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T16:33:29.946 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T16:33:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T16:33:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T16:33:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T16:33:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T16:33:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T16:33:29.947 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T16:33:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T16:33:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T16:33:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T16:33:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T16:33:29.948 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T16:33:30.040 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:30.128 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:33:30.170 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:30.171 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:33:30.171 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:30.243 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install cephadm 2024-09-17T16:33:30.832 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:30.964 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:30.965 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:30.965 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:33:30.965 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:30.965 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:33:30.965 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 784 k 2024-09-17T16:33:30.965 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:30.965 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:33:30.966 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:30.966 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:33:30.966 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:30.966 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 784 k 2024-09-17T16:33:30.966 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 791 k 2024-09-17T16:33:30.966 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:33:31.124 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T16:33:31.124 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:31.124 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:33:31.124 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:31.124 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:31.124 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T16:33:31.125 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T16:33:31.126 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:31.127 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:31.231 INFO:teuthology.orchestra.run.smithi165.stdout:cephadm-19.3.0-4975.g1889a165.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-17T16:33:31.231 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:31.232 INFO:teuthology.orchestra.run.smithi165.stdout:Total 2.9 MB/s | 784 kB 00:00 2024-09-17T16:33:31.232 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:33:31.237 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:33:31.237 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:33:31.243 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:33:31.243 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:33:31.314 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:33:31.461 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-base 2024-09-17T16:33:31.785 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:31.877 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:32.042 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:32.131 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:33:32.173 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:32.173 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:33:32.174 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:32.239 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install cephadm 2024-09-17T16:33:32.240 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:32.509 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:32.509 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:32.509 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:33:32.510 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:32.510 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:32.510 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:32.724 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T16:33:32.821 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:32.951 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 784 k 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:32.952 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:33:32.953 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:32.953 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 784 k 2024-09-17T16:33:32.953 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 791 k 2024-09-17T16:33:32.953 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:33:33.219 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm-19.3.0-4975.g1889a165.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-17T16:33:33.220 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:33.220 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.9 MB/s | 784 kB 00:00 2024-09-17T16:33:33.220 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:33:33.225 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:33:33.225 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:33:33.232 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:33:33.232 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:33:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:33:33.323 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:33.460 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:33.461 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-17T16:33:33.462 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:33.462 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:33:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4975.g1889a165.el9 ceph 145 k 2024-09-17T16:33:33.462 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:33.462 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:33:33.463 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:33.463 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:33:33.463 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:33.463 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 145 k 2024-09-17T16:33:33.463 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 432 k 2024-09-17T16:33:33.463 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:33:33.671 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-immutable-object-cache-19.3.0-4975.g1889a1 692 kB/s | 145 kB 00:00 2024-09-17T16:33:33.671 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:33.672 INFO:teuthology.orchestra.run.smithi165.stdout:Total 687 kB/s | 145 kB 00:00 2024-09-17T16:33:33.672 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:33:33.679 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:33:33.679 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:33:33.736 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:33:33.736 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:33:33.799 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:33.875 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:33:33.890 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:33.931 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:33:33.957 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:33:33.957 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:33.957 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T16:33:33.957 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:34.333 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:34.597 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:33:34.597 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:34.597 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:33:34.597 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:34.598 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:34.598 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:34.798 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T16:33:34.973 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:33:34.973 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:34.973 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:33:34.973 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:34.973 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:34.973 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:35.211 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr 2024-09-17T16:33:35.383 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:35.518 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:35.519 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-17T16:33:35.519 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:35.519 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:33:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4975.g1889a165.el9 ceph 145 k 2024-09-17T16:33:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:35.520 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:33:35.520 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:35.520 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:33:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 145 k 2024-09-17T16:33:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 432 k 2024-09-17T16:33:35.521 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:33:35.737 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-immutable-object-cache-19.3.0-4975.g1889a1 667 kB/s | 145 kB 00:00 2024-09-17T16:33:35.738 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:35.739 INFO:teuthology.orchestra.run.smithi138.stdout:Total 663 kB/s | 145 kB 00:00 2024-09-17T16:33:35.739 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:33:35.746 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:33:35.746 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:33:35.803 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:33:35.803 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:33:35.807 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:35.897 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:33:35.940 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:35.941 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:33:35.941 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:35.945 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:33:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:33:36.010 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T16:33:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:33:36.030 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:33:36.031 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T16:33:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:36.591 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:36.725 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 14 M 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 34 k 2024-09-17T16:33:36.726 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 16 k 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-09-17T16:33:36.727 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:36.728 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 19 M 2024-09-17T16:33:36.728 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 159 M 2024-09-17T16:33:36.728 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:33:36.918 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:33:36.918 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:36.918 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:33:36.918 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:33:36.918 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:36.918 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:36.975 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4975.g188 110 kB/s | 16 kB 00:00 2024-09-17T16:33:37.001 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4975.g18 195 kB/s | 34 kB 00:00 2024-09-17T16:33:37.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr 2024-09-17T16:33:37.426 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): ceph-mgr-dashboard-19.3.0-4975.g1889a16 24 MB/s | 14 MB 00:00 2024-09-17T16:33:37.635 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.1 MB/s | 863 kB 00:00 2024-09-17T16:33:37.693 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-17T16:33:37.710 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-17T16:33:37.741 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:37.777 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-17T16:33:37.803 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-17T16:33:37.828 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-17T16:33:37.834 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:33:37.853 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-17T16:33:37.878 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:37.879 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:33:37.879 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:37.904 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): python3-protobuf-3.14.0-13.el9.noarch. 298 kB/s | 269 kB 00:00 2024-09-17T16:33:37.938 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T16:33:37.987 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-17T16:33:37.991 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:37.991 INFO:teuthology.orchestra.run.smithi165.stdout:Total 15 MB/s | 19 MB 00:01 2024-09-17T16:33:38.040 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:33:38.059 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:33:38.060 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:33:38.336 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:33:38.337 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:33:38.514 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:38.650 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 14 M 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 34 k 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 16 k 2024-09-17T16:33:38.651 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout:Install 12 Packages 2024-09-17T16:33:38.652 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:38.653 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 19 M 2024-09-17T16:33:38.653 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 159 M 2024-09-17T16:33:38.653 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:33:38.936 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:33:39.021 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T16:33:39.056 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T16:33:39.103 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T16:33:39.133 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T16:33:39.245 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T16:33:39.376 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T16:33:39.470 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T16:33:39.514 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T16:33:39.519 INFO:teuthology.orchestra.run.smithi138.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4975.g18 232 kB/s | 34 kB 00:00 2024-09-17T16:33:39.536 INFO:teuthology.orchestra.run.smithi138.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4975.g188 100 kB/s | 16 kB 00:00 2024-09-17T16:33:39.542 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:33:39.574 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 10/12 2024-09-17T16:33:39.678 INFO:teuthology.orchestra.run.smithi138.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-17T16:33:39.720 INFO:teuthology.orchestra.run.smithi138.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-09-17T16:33:39.770 INFO:teuthology.orchestra.run.smithi138.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-17T16:33:39.796 INFO:teuthology.orchestra.run.smithi138.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-17T16:33:39.863 INFO:teuthology.orchestra.run.smithi138.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-17T16:33:39.888 INFO:teuthology.orchestra.run.smithi138.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-17T16:33:39.914 INFO:teuthology.orchestra.run.smithi138.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-17T16:33:39.939 INFO:teuthology.orchestra.run.smithi138.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-17T16:33:40.098 INFO:teuthology.orchestra.run.smithi138.stdout:(11/12): ceph-mgr-dashboard-19.3.0-4975.g1889a1 20 MB/s | 14 MB 00:00 2024-09-17T16:33:40.498 INFO:teuthology.orchestra.run.smithi138.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-09-17T16:33:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:40.501 INFO:teuthology.orchestra.run.smithi138.stdout:Total 10 MB/s | 19 MB 00:01 2024-09-17T16:33:40.554 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:33:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:33:40.573 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:33:40.836 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:33:40.836 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:33:41.433 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:33:41.515 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T16:33:41.559 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T16:33:41.598 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T16:33:41.628 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T16:33:41.723 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T16:33:41.865 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T16:33:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T16:33:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T16:33:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:33:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 10/12 2024-09-17T16:33:42.775 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 11/12 2024-09-17T16:33:42.829 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 1/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 2/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 3/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T16:33:44.600 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T16:33:44.601 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T16:33:44.601 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:33:44.601 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T16:33:44.601 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T16:33:44.913 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T16:33:44.914 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T16:33:44.914 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T16:33:44.914 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T16:33:44.914 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T16:33:44.914 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T16:33:44.914 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:44.914 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:45.164 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T16:33:45.255 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 11/12 2024-09-17T16:33:45.318 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:33:45.736 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:07 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:45.868 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:45.869 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-17T16:33:45.869 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:33:45.869 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-17T16:33:45.869 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 7.4 M 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T16:33:45.870 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:45.871 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:33:45.871 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2024-09-17T16:33:45.871 INFO:teuthology.orchestra.run.smithi165.stdout:Install 12 Packages 2024-09-17T16:33:45.871 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:45.871 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 38 M 2024-09-17T16:33:45.871 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 212 M 2024-09-17T16:33:45.871 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:33:46.461 INFO:teuthology.orchestra.run.smithi165.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 930 kB/s | 191 kB 00:00 2024-09-17T16:33:46.536 INFO:teuthology.orchestra.run.smithi165.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-17T16:33:46.562 INFO:teuthology.orchestra.run.smithi165.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-09-17T16:33:46.604 INFO:teuthology.orchestra.run.smithi165.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-17T16:33:46.704 INFO:teuthology.orchestra.run.smithi165.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-49 17 MB/s | 7.4 MB 00:00 2024-09-17T16:33:46.729 INFO:teuthology.orchestra.run.smithi165.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 307 kB/s | 38 kB 00:00 2024-09-17T16:33:46.856 INFO:teuthology.orchestra.run.smithi165.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-17T16:33:46.996 INFO:teuthology.orchestra.run.smithi165.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.5 MB/s | 3.0 MB 00:00 2024-09-17T16:33:47.055 INFO:teuthology.orchestra.run.smithi165.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-17T16:33:47.230 INFO:teuthology.orchestra.run.smithi165.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 9.4 MB/s | 4.9 MB 00:00 2024-09-17T16:33:47.289 INFO:teuthology.orchestra.run.smithi165.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-17T16:33:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 1/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 2/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 3/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T16:33:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T16:33:47.547 INFO:teuthology.orchestra.run.smithi165.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-17T16:33:47.549 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:47.549 INFO:teuthology.orchestra.run.smithi165.stdout:Total 23 MB/s | 38 MB 00:01 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:47.693 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:47.903 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:33:47.928 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:33:47.928 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:33:47.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T16:33:48.347 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:33:48.347 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:33:48.536 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:09 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 7.4 M 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T16:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout:Install 12 Packages 2024-09-17T16:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 38 M 2024-09-17T16:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 212 M 2024-09-17T16:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:33:48.994 INFO:teuthology.orchestra.run.smithi138.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-17T16:33:49.086 INFO:teuthology.orchestra.run.smithi138.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.0 MB/s | 801 kB 00:00 2024-09-17T16:33:49.103 INFO:teuthology.orchestra.run.smithi138.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-17T16:33:49.107 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:33:49.170 INFO:teuthology.orchestra.run.smithi138.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-17T16:33:49.172 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T16:33:49.212 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:33:49.279 INFO:teuthology.orchestra.run.smithi138.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-49 16 MB/s | 7.4 MB 00:00 2024-09-17T16:33:49.312 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:33:49.313 INFO:teuthology.orchestra.run.smithi138.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 270 kB/s | 38 kB 00:00 2024-09-17T16:33:49.355 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T16:33:49.371 INFO:teuthology.orchestra.run.smithi138.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-09-17T16:33:49.480 INFO:teuthology.orchestra.run.smithi138.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 47 MB/s | 5.1 MB 00:00 2024-09-17T16:33:49.541 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T16:33:49.564 INFO:teuthology.orchestra.run.smithi138.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2024-09-17T16:33:49.571 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T16:33:49.589 INFO:teuthology.orchestra.run.smithi138.stdout:(10/12): python3-devel-3.9.19-8.el9.x86_64.rpm 886 kB/s | 245 kB 00:00 2024-09-17T16:33:49.614 INFO:teuthology.orchestra.run.smithi138.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.8 MB/s | 250 kB 00:00 2024-09-17T16:33:49.647 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T16:33:49.873 INFO:teuthology.orchestra.run.smithi138.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 53 MB/s | 16 MB 00:00 2024-09-17T16:33:49.874 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:49.875 INFO:teuthology.orchestra.run.smithi138.stdout:Total 32 MB/s | 38 MB 00:01 2024-09-17T16:33:50.230 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:33:50.256 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:33:50.256 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:33:50.310 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T16:33:50.434 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T16:33:50.675 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:33:50.675 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:33:51.439 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:33:51.512 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T16:33:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:33:51.661 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:33:51.689 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:33:51.698 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T16:33:51.882 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T16:33:51.914 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T16:33:51.990 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T16:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T16:33:52.720 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T16:33:52.746 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:33:52.753 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T16:33:54.001 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:33:55.037 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T16:33:55.069 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:33:55.247 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:33:55.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 1/12 2024-09-17T16:33:55.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:33:55.247 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:33:55.248 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T16:33:55.630 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T16:33:55.630 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:55.630 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:33:55.630 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:55.631 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:33:56.018 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-rook 2024-09-17T16:33:56.612 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:18 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:33:56.747 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:33:56.748 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:56.748 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:33:56.748 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 49 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T16:33:56.749 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T16:33:56.750 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T16:33:56.750 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T16:33:56.750 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:56.750 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:33:56.750 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:33:56.750 INFO:teuthology.orchestra.run.smithi165.stdout:Install 13 Packages 2024-09-17T16:33:56.750 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:33:56.751 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 2.2 M 2024-09-17T16:33:56.751 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 26 M 2024-09-17T16:33:56.751 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:33:57.024 INFO:teuthology.orchestra.run.smithi165.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 291 kB/s | 26 kB 00:00 2024-09-17T16:33:57.049 INFO:teuthology.orchestra.run.smithi165.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 169 kB/s | 19 kB 00:00 2024-09-17T16:33:57.107 INFO:teuthology.orchestra.run.smithi165.stdout:(3/13): ceph-mgr-rook-19.3.0-4975.g1889a165.el9 287 kB/s | 49 kB 00:00 2024-09-17T16:33:57.158 INFO:teuthology.orchestra.run.smithi165.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-17T16:33:57.183 INFO:teuthology.orchestra.run.smithi165.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-17T16:33:57.217 INFO:teuthology.orchestra.run.smithi165.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 916 kB/s | 54 kB 00:00 2024-09-17T16:33:57.251 INFO:teuthology.orchestra.run.smithi165.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 479 kB/s | 32 kB 00:00 2024-09-17T16:33:57.276 INFO:teuthology.orchestra.run.smithi165.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 248 kB/s | 14 kB 00:00 2024-09-17T16:33:57.301 INFO:teuthology.orchestra.run.smithi165.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-17T16:33:57.326 INFO:teuthology.orchestra.run.smithi165.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-17T16:33:57.352 INFO:teuthology.orchestra.run.smithi165.stdout:(11/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-09-17T16:33:57.377 INFO:teuthology.orchestra.run.smithi165.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-17T16:33:57.410 INFO:teuthology.orchestra.run.smithi165.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-17T16:33:57.412 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:33:57.412 INFO:teuthology.orchestra.run.smithi165.stdout:Total 3.3 MB/s | 2.2 MB 00:00 2024-09-17T16:33:57.478 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:33:57.493 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:33:57.493 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:33:57.582 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:33:57.583 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:33:57.766 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:33:57.766 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 1/12 2024-09-17T16:33:57.766 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:33:57.766 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:33:57.766 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T16:33:57.766 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T16:33:57.767 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T16:33:57.767 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T16:33:57.767 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T16:33:57.767 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T16:33:57.767 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:33:57.767 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T16:33:58.086 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T16:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T16:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T16:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T16:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T16:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T16:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:33:58.250 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T16:33:58.311 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T16:33:58.367 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T16:33:58.405 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T16:33:58.446 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T16:33:58.549 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T16:33:58.575 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-rook 2024-09-17T16:33:58.658 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T16:33:58.714 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T16:33:59.176 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:20 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:33:59.308 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:33:59.309 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:59.309 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:33:59.309 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:59.309 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 49 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T16:33:59.310 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T16:33:59.311 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T16:33:59.311 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:59.311 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:33:59.311 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:33:59.311 INFO:teuthology.orchestra.run.smithi138.stdout:Install 13 Packages 2024-09-17T16:33:59.311 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:33:59.311 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.2 M 2024-09-17T16:33:59.312 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 26 M 2024-09-17T16:33:59.312 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:33:59.436 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T16:33:59.487 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T16:33:59.521 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T16:33:59.568 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T16:33:59.590 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:33:59.840 INFO:teuthology.orchestra.run.smithi138.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 315 kB/s | 26 kB 00:00 2024-09-17T16:33:59.865 INFO:teuthology.orchestra.run.smithi138.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 180 kB/s | 19 kB 00:00 2024-09-17T16:33:59.941 INFO:teuthology.orchestra.run.smithi138.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-17T16:33:59.966 INFO:teuthology.orchestra.run.smithi138.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-17T16:33:59.991 INFO:teuthology.orchestra.run.smithi138.stdout:(5/13): ceph-mgr-rook-19.3.0-4975.g1889a165.el9 212 kB/s | 49 kB 00:00 2024-09-17T16:34:00.017 INFO:teuthology.orchestra.run.smithi138.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T16:34:00.042 INFO:teuthology.orchestra.run.smithi138.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-17T16:34:00.092 INFO:teuthology.orchestra.run.smithi138.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 319 kB/s | 32 kB 00:00 2024-09-17T16:34:00.118 INFO:teuthology.orchestra.run.smithi138.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-17T16:34:00.143 INFO:teuthology.orchestra.run.smithi138.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-17T16:34:00.169 INFO:teuthology.orchestra.run.smithi138.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-17T16:34:00.185 INFO:teuthology.orchestra.run.smithi138.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-09-17T16:34:00.227 INFO:teuthology.orchestra.run.smithi138.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-17T16:34:00.230 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:00.230 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-17T16:34:00.294 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:00.309 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:00.309 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:00.320 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 1/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T16:34:00.321 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T16:34:00.397 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:00.398 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T16:34:00.644 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T16:34:00.645 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T16:34:00.645 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T16:34:00.645 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T16:34:00.645 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T16:34:00.645 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T16:34:00.645 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:00.645 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:00.918 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:00.947 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T16:34:01.082 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T16:34:01.137 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T16:34:01.193 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T16:34:01.231 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T16:34:01.272 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T16:34:01.375 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T16:34:01.484 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T16:34:01.524 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:01.532 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T16:34:01.656 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:01.657 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:01.657 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:34:01.657 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:01.657 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:01.657 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 154 k 2024-09-17T16:34:01.657 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:34:01.657 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout:Install 6 Packages 2024-09-17T16:34:01.658 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:01.659 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 7.0 M 2024-09-17T16:34:01.659 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 33 M 2024-09-17T16:34:01.659 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:02.196 INFO:teuthology.orchestra.run.smithi165.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-17T16:34:02.221 INFO:teuthology.orchestra.run.smithi165.stdout:(2/6): ceph-mgr-cephadm-19.3.0-4975.g1889a165.e 697 kB/s | 154 kB 00:00 2024-09-17T16:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T16:34:02.280 INFO:teuthology.orchestra.run.smithi165.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-17T16:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T16:34:02.306 INFO:teuthology.orchestra.run.smithi165.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 689 kB/s | 58 kB 00:00 2024-09-17T16:34:02.331 INFO:teuthology.orchestra.run.smithi165.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-17T16:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T16:34:02.388 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T16:34:02.410 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:34:03.023 INFO:teuthology.orchestra.run.smithi165.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.8 MB/s | 6.0 MB 00:01 2024-09-17T16:34:03.025 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:03.025 INFO:teuthology.orchestra.run.smithi165.stdout:Total 5.1 MB/s | 7.0 MB 00:01 2024-09-17T16:34:03.095 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:03.106 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:03.106 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:03.206 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:03.206 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 1/13 2024-09-17T16:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T16:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T16:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T16:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T16:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T16:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T16:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T16:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T16:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T16:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T16:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T16:34:03.512 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:03.630 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T16:34:03.630 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:03.630 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:03.630 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:03.631 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:03.670 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T16:34:03.725 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T16:34:03.897 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T16:34:04.252 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T16:34:04.336 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T16:34:04.404 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T16:34:04.429 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:34:04.478 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:25 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:04.610 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:04.611 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:34:04.611 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:04.611 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 154 k 2024-09-17T16:34:04.612 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:34:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T16:34:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T16:34:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T16:34:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T16:34:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T16:34:04.612 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:04.613 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:04.613 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:04.613 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-09-17T16:34:04.613 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:04.614 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 7.0 M 2024-09-17T16:34:04.614 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 33 M 2024-09-17T16:34:04.614 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:04.943 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4975.g1889a165.e 624 kB/s | 154 kB 00:00 2024-09-17T16:34:04.993 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-17T16:34:05.018 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T16:34:05.043 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-17T16:34:05.214 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:34:05.214 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/6 2024-09-17T16:34:05.214 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T16:34:05.214 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T16:34:05.215 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T16:34:05.215 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T16:34:05.244 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 452 kB/s | 248 kB 00:00 2024-09-17T16:34:05.502 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T16:34:05.502 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:05.502 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:05.502 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:34:05.502 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T16:34:05.502 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T16:34:05.503 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T16:34:05.503 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T16:34:05.503 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T16:34:05.503 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:05.503 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:05.763 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-fuse 2024-09-17T16:34:06.345 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:28 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:06.481 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:06.482 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:06.482 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:34:06.482 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:06.482 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:06.482 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 899 k 2024-09-17T16:34:06.482 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-17T16:34:06.482 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout:Install 2 Packages 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 979 k 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 2.9 M 2024-09-17T16:34:06.483 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:06.719 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.9 MB/s | 6.0 MB 00:02 2024-09-17T16:34:06.721 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:06.721 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.3 MB/s | 7.0 MB 00:02 2024-09-17T16:34:06.792 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:06.804 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:06.804 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:06.850 INFO:teuthology.orchestra.run.smithi165.stdout:(1/2): ceph-fuse-19.3.0-4975.g1889a165.el9.x86_ 3.3 MB/s | 899 kB 00:00 2024-09-17T16:34:06.905 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:06.906 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:07.218 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:07.259 INFO:teuthology.orchestra.run.smithi165.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 118 kB/s | 80 kB 00:00 2024-09-17T16:34:07.260 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:07.260 INFO:teuthology.orchestra.run.smithi165.stdout:Total 1.2 MB/s | 979 kB 00:00 2024-09-17T16:34:07.272 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:07.294 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:07.295 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:07.377 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:07.378 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:07.399 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T16:34:07.446 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T16:34:07.571 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:07.711 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T16:34:07.782 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:34:07.960 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T16:34:08.174 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T16:34:08.242 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T16:34:08.268 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:34:08.445 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:34:08.445 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/2 2024-09-17T16:34:08.725 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T16:34:08.726 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:08.726 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:08.726 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T16:34:08.726 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:08.726 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:09.030 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-volume 2024-09-17T16:34:09.040 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:34:09.040 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/6 2024-09-17T16:34:09.041 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T16:34:09.041 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T16:34:09.041 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T16:34:09.041 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T16:34:09.328 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:09.329 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:09.587 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-fuse 2024-09-17T16:34:09.633 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:09.768 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 285 k 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:09.769 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:09.770 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:34:09.770 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:09.770 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 285 k 2024-09-17T16:34:09.770 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 1.3 M 2024-09-17T16:34:09.770 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:09.997 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-volume-19.3.0-4975.g1889a165.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-17T16:34:09.998 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:09.998 INFO:teuthology.orchestra.run.smithi165.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-17T16:34:09.998 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:10.007 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:10.007 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:10.037 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:10.038 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:10.164 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:31 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:10.264 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:10.296 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 899 k 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:10.297 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:10.298 INFO:teuthology.orchestra.run.smithi138.stdout:Install 2 Packages 2024-09-17T16:34:10.298 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:10.298 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 979 k 2024-09-17T16:34:10.298 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 2.9 M 2024-09-17T16:34:10.298 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:10.325 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:34:10.341 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:34:10.341 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:34:10.341 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T16:34:10.342 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:10.449 INFO:teuthology.orchestra.run.smithi138.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 761 kB/s | 80 kB 00:00 2024-09-17T16:34:10.608 INFO:teuthology.orchestra.run.smithi138.stdout:(2/2): ceph-fuse-19.3.0-4975.g1889a165.el9.x86_ 3.3 MB/s | 899 kB 00:00 2024-09-17T16:34:10.608 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:10.609 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.1 MB/s | 979 kB 00:00 2024-09-17T16:34:10.620 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:10.642 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:10.642 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:10.723 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:10.724 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:10.911 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:11.035 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T16:34:11.107 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:34:11.300 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:34:11.300 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:11.300 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:11.300 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:34:11.300 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:11.300 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:11.589 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados-devel 2024-09-17T16:34:11.845 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:34:11.845 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/2 2024-09-17T16:34:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T16:34:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:12.122 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T16:34:12.122 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:12.122 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:12.188 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:12.325 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:12.325 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:12.325 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 126 k 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:34:12.326 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:12.327 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 126 k 2024-09-17T16:34:12.327 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 456 k 2024-09-17T16:34:12.327 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:12.425 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-volume 2024-09-17T16:34:12.556 INFO:teuthology.orchestra.run.smithi165.stdout:librados-devel-19.3.0-4975.g1889a165.el9.x86_64 552 kB/s | 126 kB 00:00 2024-09-17T16:34:12.557 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:12.557 INFO:teuthology.orchestra.run.smithi165.stdout:Total 549 kB/s | 126 kB 00:00 2024-09-17T16:34:12.557 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:12.563 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:12.563 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:12.627 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:12.627 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:12.786 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:12.876 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:13.019 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:13.154 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:13.155 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:13.156 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-17T16:34:13.156 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:13.156 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:13.156 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 285 k 2024-09-17T16:34:13.156 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:13.156 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:13.157 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:13.157 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:34:13.157 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:13.157 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 285 k 2024-09-17T16:34:13.157 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 1.3 M 2024-09-17T16:34:13.157 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:13.296 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:13.383 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-volume-19.3.0-4975.g1889a165.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-17T16:34:13.383 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:13.384 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-17T16:34:13.384 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:13.392 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:13.392 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:13.423 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:13.424 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:13.540 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:13.540 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:13.540 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:13.540 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:13.540 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:13.541 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:13.645 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:13.710 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:34:13.726 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:34:13.726 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:34:13.726 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T16:34:13.727 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:13.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs2 2024-09-17T16:34:14.341 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:14.433 INFO:teuthology.orchestra.run.smithi165.stdout:Package libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:14.476 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:14.477 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:34:14.477 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:14.554 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs-devel 2024-09-17T16:34:14.736 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:34:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:14.737 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:34:14.737 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:14.737 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:15.055 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados-devel 2024-09-17T16:34:15.133 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:15.264 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 32 k 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 32 k 2024-09-17T16:34:15.267 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 142 k 2024-09-17T16:34:15.267 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:15.417 INFO:teuthology.orchestra.run.smithi165.stdout:libcephfs-devel-19.3.0-4975.g1889a165.el9.x86_6 211 kB/s | 32 kB 00:00 2024-09-17T16:34:15.417 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:15.417 INFO:teuthology.orchestra.run.smithi165.stdout:Total 209 kB/s | 32 kB 00:00 2024-09-17T16:34:15.417 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:15.421 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:15.421 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:15.440 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:15.441 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:15.525 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:15.630 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:15.644 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:15.776 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:15.777 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:15.777 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-17T16:34:15.777 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:15.777 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 126 k 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 126 k 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 456 k 2024-09-17T16:34:15.778 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:15.982 INFO:teuthology.orchestra.run.smithi138.stdout:librados-devel-19.3.0-4975.g1889a165.el9.x86_64 618 kB/s | 126 kB 00:00 2024-09-17T16:34:15.983 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:15.983 INFO:teuthology.orchestra.run.smithi138.stdout:Total 614 kB/s | 126 kB 00:00 2024-09-17T16:34:15.984 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:15.989 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:15.989 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:16.019 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:16.053 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:16.054 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:16.213 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:16.255 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:16.255 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:16.255 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:16.255 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:16.255 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:16.256 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:16.313 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:16.421 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados2 2024-09-17T16:34:16.765 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:17.001 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:17.018 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:17.018 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:17.018 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:17.018 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:17.018 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:17.018 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:17.091 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:17.134 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:17.135 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:34:17.135 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:17.209 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librbd1 2024-09-17T16:34:17.259 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs2 2024-09-17T16:34:17.790 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:17.850 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:17.879 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:17.921 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:17.922 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:34:17.922 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:17.940 INFO:teuthology.orchestra.run.smithi138.stdout:Package libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:17.983 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:17.984 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:34:17.984 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:17.992 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rados 2024-09-17T16:34:18.061 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs-devel 2024-09-17T16:34:18.572 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:40 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:18.662 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:18.664 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:18.706 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:18.707 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:34:18.707 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:18.782 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rgw 2024-09-17T16:34:18.804 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 32 k 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 32 k 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 142 k 2024-09-17T16:34:18.806 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:18.948 INFO:teuthology.orchestra.run.smithi138.stdout:libcephfs-devel-19.3.0-4975.g1889a165.el9.x86_6 223 kB/s | 32 kB 00:00 2024-09-17T16:34:18.950 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:18.950 INFO:teuthology.orchestra.run.smithi138.stdout:Total 220 kB/s | 32 kB 00:00 2024-09-17T16:34:18.950 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:18.956 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:18.957 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:18.977 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:18.977 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:19.074 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:19.180 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:19.365 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:19.453 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:19.497 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:19.498 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:34:19.498 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:19.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-cephfs 2024-09-17T16:34:19.565 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:19.792 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:19.793 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:19.971 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados2 2024-09-17T16:34:20.134 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:20.223 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:20.266 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:20.267 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:34:20.268 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:20.343 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rbd 2024-09-17T16:34:20.572 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:20.662 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:20.705 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:20.705 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:34:20.706 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:20.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librbd1 2024-09-17T16:34:20.929 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:21.018 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:21.062 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:21.063 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2024-09-17T16:34:21.063 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:21.132 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-fuse 2024-09-17T16:34:21.351 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:21.441 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:21.486 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:21.486 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:34:21.487 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:21.545 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rados 2024-09-17T16:34:21.712 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:21.845 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 85 k 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:21.846 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 85 k 2024-09-17T16:34:21.847 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 231 k 2024-09-17T16:34:21.847 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:22.044 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-fuse-19.3.0-4975.g1889a165.el9.x86_64.rpm 431 kB/s | 85 kB 00:00 2024-09-17T16:34:22.045 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:22.045 INFO:teuthology.orchestra.run.smithi165.stdout:Total 428 kB/s | 85 kB 00:00 2024-09-17T16:34:22.045 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:22.052 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:22.053 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:22.115 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:22.116 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:22.121 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:22.212 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:22.255 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:22.256 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:34:22.256 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:22.273 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:22.322 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rgw 2024-09-17T16:34:22.375 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:22.745 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:22.904 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:22.994 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:23.008 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:23.008 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:23.008 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:23.008 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:23.008 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:23.008 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:23.038 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:23.039 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:34:23.039 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:23.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-cephfs 2024-09-17T16:34:23.293 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-mirror 2024-09-17T16:34:23.678 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:23.780 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:23.811 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:23.812 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:34:23.812 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:23.872 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rbd 2024-09-17T16:34:23.922 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:24.062 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.2 M 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:24.063 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:34:24.064 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:24.064 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 3.2 M 2024-09-17T16:34:24.064 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 14 M 2024-09-17T16:34:24.064 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:24.416 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-mirror-19.3.0-4975.g1889a165.el9.x86_64.rpm 9.1 MB/s | 3.2 MB 00:00 2024-09-17T16:34:24.418 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:24.418 INFO:teuthology.orchestra.run.smithi165.stdout:Total 9.0 MB/s | 3.2 MB 00:00 2024-09-17T16:34:24.418 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:24.427 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:24.427 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:24.456 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:24.512 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:24.513 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:24.546 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:34:24.588 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:24.589 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-17T16:34:24.589 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:24.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-fuse 2024-09-17T16:34:24.970 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:25.034 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:25.060 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:25.060 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:34:25.060 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T16:34:25.060 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:34:25.060 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:34:25.060 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:25.234 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:25.366 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 85 k 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:25.367 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:34:25.368 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:25.368 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 85 k 2024-09-17T16:34:25.368 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 231 k 2024-09-17T16:34:25.368 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:25.569 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-fuse-19.3.0-4975.g1889a165.el9.x86_64.rpm 423 kB/s | 85 kB 00:00 2024-09-17T16:34:25.569 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:25.570 INFO:teuthology.orchestra.run.smithi138.stdout:Total 420 kB/s | 85 kB 00:00 2024-09-17T16:34:25.570 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:25.577 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:25.577 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:25.640 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:25.640 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:25.788 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:26.189 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:26.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:26.190 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:26.190 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:26.190 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:26.190 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:26.296 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:26.423 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-nbd 2024-09-17T16:34:26.546 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:26.546 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:26.547 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:26.547 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:26.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:26.547 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:26.823 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-mirror 2024-09-17T16:34:27.019 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:49 ago on Tue 17 Sep 2024 04:32:38 PM UTC. 2024-09-17T16:34:27.152 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 170 k 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-17T16:34:27.153 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2024-09-17T16:34:27.154 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2024-09-17T16:34:27.154 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:27.154 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 170 k 2024-09-17T16:34:27.154 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 490 k 2024-09-17T16:34:27.154 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-17T16:34:27.362 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-nbd-19.3.0-4975.g1889a165.el9.x86_64.rpm 818 kB/s | 170 kB 00:00 2024-09-17T16:34:27.362 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:27.363 INFO:teuthology.orchestra.run.smithi165.stdout:Total 813 kB/s | 170 kB 00:00 2024-09-17T16:34:27.363 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-17T16:34:27.371 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-17T16:34:27.371 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-17T16:34:27.417 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:27.435 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-17T16:34:27.435 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-17T16:34:27.557 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:27.557 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.2 M 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 3.2 M 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 14 M 2024-09-17T16:34:27.558 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:27.587 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-17T16:34:27.684 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:27.883 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-mirror-19.3.0-4975.g1889a165.el9.x86_64.rpm 9.8 MB/s | 3.2 MB 00:00 2024-09-17T16:34:27.883 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:27.884 INFO:teuthology.orchestra.run.smithi138.stdout:Total 9.8 MB/s | 3.2 MB 00:00 2024-09-17T16:34:27.884 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:27.893 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:27.893 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:27.975 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:27.975 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:28.104 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:28.383 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:28.384 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:28.384 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-17T16:34:28.384 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:28.384 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:28.384 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-17T16:34:28.416 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:28.475 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:28.500 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:28.500 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:34:28.501 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T16:34:28.501 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:34:28.501 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:34:28.501 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:28.618 DEBUG:teuthology.parallel:result is None 2024-09-17T16:34:29.593 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:29.594 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:29.594 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:29.594 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:29.594 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:29.594 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:29.818 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-nbd 2024-09-17T16:34:30.410 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Sep 2024 04:32:39 PM UTC. 2024-09-17T16:34:30.546 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 170 k 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:30.547 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 170 k 2024-09-17T16:34:30.548 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 490 k 2024-09-17T16:34:30.548 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-17T16:34:30.753 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-nbd-19.3.0-4975.g1889a165.el9.x86_64.rpm 829 kB/s | 170 kB 00:00 2024-09-17T16:34:30.753 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:34:30.754 INFO:teuthology.orchestra.run.smithi138.stdout:Total 824 kB/s | 170 kB 00:00 2024-09-17T16:34:30.754 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-17T16:34:30.761 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-17T16:34:30.761 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-17T16:34:30.825 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-17T16:34:30.826 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-17T16:34:30.979 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-17T16:34:31.074 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:31.513 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:31.793 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:34:31.793 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:31.793 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-17T16:34:31.793 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:34:31.793 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:31.794 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-17T16:34:32.040 DEBUG:teuthology.parallel:result is None 2024-09-17T16:34:32.040 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:34:32.199 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T16:34:32.221 INFO:teuthology.orchestra.run.smithi138.stdout:19.3.0-4975.g1889a165.el9 2024-09-17T16:34:32.222 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975.g1889a165.el9 2024-09-17T16:34:32.223 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975.g1889a165 is installed. 2024-09-17T16:34:32.225 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:34:32.378 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T16:34:32.403 INFO:teuthology.orchestra.run.smithi165.stdout:19.3.0-4975.g1889a165.el9 2024-09-17T16:34:32.404 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975.g1889a165.el9 2024-09-17T16:34:32.404 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975.g1889a165 is installed. 2024-09-17T16:34:32.406 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T16:34:32.406 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:32.406 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T16:34:32.433 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:34:32.433 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T16:34:32.473 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T16:34:32.474 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:32.474 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T16:34:32.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T16:34:32.565 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:34:32.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T16:34:32.594 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T16:34:32.663 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T16:34:32.663 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:32.663 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T16:34:32.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T16:34:32.760 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:34:32.760 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T16:34:32.790 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T16:34:32.858 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T16:34:32.859 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:32.859 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T16:34:32.884 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T16:34:32.949 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:34:32.949 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T16:34:32.977 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T16:34:33.044 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T16:34:33.122 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T16:34:33.122 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-09-17T16:34:33.125 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2024-09-17T16:34:33.150 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T16:34:33.150 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T16:34:33.190 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T16:34:33.216 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T16:34:33.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T16:34:33.255 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T16:34:33.290 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T16:34:33.290 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-09-17T16:34:33.290 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077', 'branch': 'wip-bharath10-testing-2024-09-17-1348', 'description': 'rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest}}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'job_id': '7909077', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath10-testing-2024-09-17-1348'}, 'ceph': {'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath10-testing-2024-09-17-1348', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'owner': 'scheduled_skanta@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'], ['osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 3421, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath10-testing-2024-09-17-1348', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'targets': {'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBke5YS85KnBiq6fRelkZtK5v/qLpF0f/kMxj5C//R6vMzE+6dbQoMx7CknCuSq1gQ1MjvFTTONwdQ2QYSdkt68=', 'smithi165.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLWt8x38Gdr6mIYxp7WuzU8saS0ULgNJdnfN/pZ+TDvARZvCu+iDFPO+dry2W6imkukVRYiXVEmMv38mC4aMFZc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['missing primary copy of', 'objects unfound and apparently lost', 'had a read error', 'overall HEALTH_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_DEGRADED\\)', '\\(OSD_TOO_MANY_REPAIRS\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'mon_bind_msgr2': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'cluster': 'ceph'}}, {'full_sequential': [{'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33', 'sudo ceph osd pool create test 16 16', 'sudo ceph osd pool set test size 3', 'sudo ceph pg dump pgs --format=json-pretty']}}, {'radosbench': {'clients': ['client.0'], 'create_pool': False, 'objectsize': 1048576, 'pool': 'test', 'time': 360, 'type': 'rand'}}, {'exec': {'client.0': ['sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0']}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_15:01:33', 'tube': 'smithi', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T16:34:33.291 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T16:34:33.320 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T16:34:33.337 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T16:34:33.376 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T16:34:33.405 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:33.405 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T16:34:33.456 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T16:34:33.456 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-17T16:34:33.511 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T16:34:33.511 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:33.511 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T16:34:33.512 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:33.512 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:33.512 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-17 16:34:28.750722864 +0000 2024-09-17T16:34:33.512 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-17 16:31:56.885801831 +0000 2024-09-17T16:34:33.512 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-17 16:31:56.885801831 +0000 2024-09-17T16:34:33.512 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-17 16:31:56.885801831 +0000 2024-09-17T16:34:33.512 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T16:34:33.574 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-17T16:34:33.574 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-17T16:34:33.574 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000241083 s, 2.1 MB/s 2024-09-17T16:34:33.576 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T16:34:33.632 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-17T16:34:33.687 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T16:34:33.687 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:33.687 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T16:34:33.687 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:33.688 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:33.688 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-17 16:34:28.750722864 +0000 2024-09-17T16:34:33.688 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-17 16:31:57.214794955 +0000 2024-09-17T16:34:33.688 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-17 16:31:57.214794955 +0000 2024-09-17T16:34:33.688 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-17 16:31:57.214794955 +0000 2024-09-17T16:34:33.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T16:34:33.750 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-17T16:34:33.750 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-17T16:34:33.750 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000199294 s, 2.6 MB/s 2024-09-17T16:34:33.751 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T16:34:33.808 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-17T16:34:33.863 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T16:34:33.863 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:33.864 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T16:34:33.864 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:33.864 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:33.864 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-17 16:34:28.751722843 +0000 2024-09-17T16:34:33.864 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-17 16:31:57.547787995 +0000 2024-09-17T16:34:33.864 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-17 16:31:57.547787995 +0000 2024-09-17T16:34:33.864 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-17 16:31:57.547787995 +0000 2024-09-17T16:34:33.864 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T16:34:33.926 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-17T16:34:33.927 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-17T16:34:33.927 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000257242 s, 2.0 MB/s 2024-09-17T16:34:33.928 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T16:34:33.984 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-17T16:34:34.039 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T16:34:34.039 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:34.039 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T16:34:34.039 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:34.039 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:34.039 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-17 16:34:28.751722843 +0000 2024-09-17T16:34:34.040 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-17 16:31:57.868781286 +0000 2024-09-17T16:34:34.040 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-17 16:31:57.868781286 +0000 2024-09-17T16:34:34.040 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-17 16:31:57.868781286 +0000 2024-09-17T16:34:34.040 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T16:34:34.102 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-17T16:34:34.102 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-17T16:34:34.102 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000185247 s, 2.8 MB/s 2024-09-17T16:34:34.103 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T16:34:34.159 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:34.159 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:34:34.159 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T16:34:34.177 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T16:34:34.177 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-17 16:34:25.330196951 +0000 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-17 16:31:56.877482313 +0000 2024-09-17T16:34:34.233 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-17 16:31:56.877482313 +0000 2024-09-17T16:34:34.234 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-17 16:31:56.877482313 +0000 2024-09-17T16:34:34.234 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T16:34:34.298 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-17T16:34:34.298 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-17T16:34:34.298 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000213867 s, 2.4 MB/s 2024-09-17T16:34:34.299 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T16:34:34.357 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-17 16:34:25.331196937 +0000 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-17 16:31:57.213477441 +0000 2024-09-17T16:34:34.413 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-17 16:31:57.213477441 +0000 2024-09-17T16:34:34.414 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-17 16:31:57.213477441 +0000 2024-09-17T16:34:34.414 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T16:34:34.477 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-17T16:34:34.478 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-17T16:34:34.478 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000180456 s, 2.8 MB/s 2024-09-17T16:34:34.479 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T16:34:34.535 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-17 16:34:25.331196937 +0000 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-17 16:31:57.558472438 +0000 2024-09-17T16:34:34.591 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-17 16:31:57.558472438 +0000 2024-09-17T16:34:34.592 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-17 16:31:57.558472438 +0000 2024-09-17T16:34:34.592 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T16:34:34.656 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-17T16:34:34.656 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-17T16:34:34.656 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000209728 s, 2.4 MB/s 2024-09-17T16:34:34.657 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T16:34:34.714 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-17 16:34:25.331196937 +0000 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-17 16:31:57.892467594 +0000 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-17 16:31:57.892467594 +0000 2024-09-17T16:34:34.769 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-17 16:31:57.892467594 +0000 2024-09-17T16:34:34.770 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T16:34:34.832 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-17T16:34:34.832 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-17T16:34:34.832 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000249408 s, 2.1 MB/s 2024-09-17T16:34:34.833 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T16:34:34.890 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:34.890 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-17T16:34:34.890 INFO:tasks.ceph:Generating config... 2024-09-17T16:34:34.891 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-17T16:34:34.891 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-17T16:34:34.891 INFO:tasks.ceph:[global] ms type = async 2024-09-17T16:34:34.892 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T16:34:34.892 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T16:34:34.892 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T16:34:34.892 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T16:34:34.892 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T16:34:34.892 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T16:34:34.892 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-17T16:34:34.893 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-17T16:34:34.894 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T16:34:34.894 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T16:34:34.948 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T16:34:34.951 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T16:34:34.996 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:34:35.062 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.138:6789]')] 2024-09-17T16:34:35.062 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.138:6789]', 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2024-09-17T16:34:35.063 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:35.063 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T16:34:35.118 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.138:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:35.198 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:35.198 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: generated fsid dc020b28-a66a-430c-bfac-6db0c0fa2d85 2024-09-17T16:34:35.198 INFO:teuthology.orchestra.run.smithi138.stdout:setting min_mon_release = quincy 2024-09-17T16:34:35.198 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 0 2024-09-17T16:34:35.198 INFO:teuthology.orchestra.run.smithi138.stdout:fsid dc020b28-a66a-430c-bfac-6db0c0fa2d85 2024-09-17T16:34:35.198 INFO:teuthology.orchestra.run.smithi138.stdout:last_changed 2024-09-17T16:34:35.197043+0000 2024-09-17T16:34:35.199 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-09-17T16:34:35.197043+0000 2024-09-17T16:34:35.199 INFO:teuthology.orchestra.run.smithi138.stdout:min_mon_release 17 (quincy) 2024-09-17T16:34:35.199 INFO:teuthology.orchestra.run.smithi138.stdout:election_strategy: 3 2024-09-17T16:34:35.199 INFO:teuthology.orchestra.run.smithi138.stdout:0: v1:172.21.15.138:6789/0 mon.a 2024-09-17T16:34:35.199 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-17T16:34:35.200 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T16:34:35.255 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dc020b28-a66a-430c-bfac-6db0c0fa2d85... 2024-09-17T16:34:35.256 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T16:34:35.298 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T16:34:35.338 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-09-17T16:34:35.338 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.339 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-09-17T16:34:35.340 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-09-17T16:34:35.341 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = [v1:172.21.15.138:6789] 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: mon election default strategy = 3 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: ms bind msgr2 = False 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: ms type = async 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = dc020b28-a66a-430c-bfac-6db0c0fa2d85 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-09-17T16:34:35.342 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.343 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression algorithm = snappy 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression mode = aggressive 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore write v2 random = True 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore zero block detection = True 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-09-17T16:34:35.344 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify cached snaps = True 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify missing on start = True 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock override recovery settings = True 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: osd op queue = debug_random 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: osd op queue cut off = debug_random 2024-09-17T16:34:35.345 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-17T16:34:35.346 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T16:34:35.347 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: mon scrub interval = 300 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-09-17T16:34:35.348 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-09-17T16:34:35.349 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T16:34:35.349 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T16:34:35.349 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-09-17T16:34:35.349 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2024-09-17T16:34:35.349 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2024-09-17T16:34:35.349 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.350 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2024-09-17T16:34:35.351 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2024-09-17T16:34:35.352 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = [v1:172.21.15.138:6789] 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: mon election default strategy = 3 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: ms bind msgr2 = False 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: ms type = async 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = dc020b28-a66a-430c-bfac-6db0c0fa2d85 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.353 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock profile = high_recovery_ops 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2024-09-17T16:34:35.354 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug trim objects = true 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.355 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore compression algorithm = snappy 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore compression mode = aggressive 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore write v2 random = True 2024-09-17T16:34:35.356 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore zero block detection = True 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 20 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 20 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 10 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify cached snaps = True 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify missing on start = True 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock override recovery settings = True 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2024-09-17T16:34:35.357 INFO:teuthology.orchestra.run.smithi165.stdout: osd op queue = debug_random 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: osd op queue cut off = debug_random 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2024-09-17T16:34:35.358 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2024-09-17T16:34:35.359 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2024-09-17T16:34:35.360 INFO:teuthology.orchestra.run.smithi165.stdout: mon scrub interval = 300 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T16:34:35.361 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2024-09-17T16:34:35.362 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T16:34:35.363 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T16:34:35.457 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T16:34:35.457 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:35.458 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T16:34:35.473 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:35.473 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T16:34:35.528 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:34:35.528 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:35.528 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T16:34:35.528 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:34:35.603 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:34:35.603 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:35.658 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:34:35.658 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:34:35.658 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T16:34:35.658 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:34:35.694 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:34:35.694 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:35.749 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T16:34:35.750 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T16:34:35.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T16:34:35.802 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T16:34:35.805 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T16:34:35.805 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T16:34:35.805 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T16:34:35.854 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T16:34:35.866 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T16:34:35.867 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-17T16:34:35.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T16:34:35.893 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:35.893 INFO:tasks.ceph:role: osd.0 2024-09-17T16:34:35.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:34:35.893 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T16:34:35.965 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:34:35.965 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:34:35.965 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:34:35.965 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:34:35.965 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:34:35.965 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:34:35.966 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:34:35.966 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:34:35.966 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:34:35.966 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:34:36.462 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-17T16:34:36.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-17T16:34:36.465 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T16:34:36.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T16:34:36.620 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T16:34:36.686 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:36.686 INFO:tasks.ceph:role: osd.1 2024-09-17T16:34:36.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:34:36.687 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T16:34:36.759 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:34:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:34:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:34:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:34:36.759 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:34:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:34:36.760 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:34:36.760 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:34:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:34:36.760 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:34:37.216 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-17T16:34:37.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-17T16:34:37.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T16:34:37.311 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T16:34:37.341 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T16:34:37.406 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:37.407 INFO:tasks.ceph:role: osd.2 2024-09-17T16:34:37.407 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:34:37.407 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:34:37.480 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:34:37.960 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-17T16:34:37.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-17T16:34:37.962 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T16:34:38.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T16:34:38.115 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:38.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:38.206+0000 7fc44efdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T16:34:38.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:38.209+0000 7fc44efdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T16:34:38.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:38.209+0000 7fc44efdd640 -1 bdev(0x56246a4e1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T16:34:38.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:38.209+0000 7fc44efdd640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T16:34:41.366 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T16:34:41.396 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:41.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:41.483+0000 7fabf3e0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T16:34:41.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:41.484+0000 7fabf3e0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T16:34:41.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:41.484+0000 7fabf3e0e640 -1 bdev(0x5559efa99800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T16:34:41.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:41.484+0000 7fabf3e0e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T16:34:44.642 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T16:34:44.671 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:44.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:44.758+0000 7f3d2a3cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T16:34:44.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:44.759+0000 7f3d2a3cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T16:34:44.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:44.759+0000 7f3d2a3cc640 -1 bdev(0x55666190d800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T16:34:44.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-17T16:34:44.759+0000 7f3d2a3cc640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T16:34:48.420 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T16:34:48.449 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T16:34:48.480 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:48.480 INFO:tasks.ceph:role: osd.3 2024-09-17T16:34:48.481 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:34:48.481 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T16:34:48.557 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:34:48.557 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:34:48.557 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:34:48.557 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:34:48.557 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:34:48.557 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:34:48.558 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:34:48.558 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:34:48.558 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:34:48.558 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:34:49.071 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-17T16:34:49.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-17T16:34:49.074 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-17T16:34:49.210 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T16:34:49.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T16:34:49.313 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:49.313 INFO:tasks.ceph:role: osd.4 2024-09-17T16:34:49.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:34:49.313 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T16:34:49.388 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:34:49.389 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:34:49.828 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-17T16:34:49.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-17T16:34:49.830 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-17T16:34:49.917 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T16:34:49.946 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T16:34:50.012 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-17T16:34:50.012 INFO:tasks.ceph:role: osd.5 2024-09-17T16:34:50.012 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:34:50.013 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T16:34:50.085 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:34:50.085 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:34:50.085 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:34:50.085 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:34:50.085 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:34:50.086 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:34:50.086 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:34:50.086 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:34:50.086 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:34:50.086 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:34:50.589 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2024-09-17T16:34:50.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2024-09-17T16:34:50.592 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-17T16:34:50.724 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T16:34:50.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:50.850 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:50.847+0000 7f9692e2a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T16:34:50.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:50.853+0000 7f9692e2a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T16:34:50.856 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:50.853+0000 7f9692e2a640 -1 bdev(0x55a6c934f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T16:34:50.857 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:50.853+0000 7f9692e2a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T16:34:54.273 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T16:34:54.302 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:54.392 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:54.389+0000 7f0222534640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T16:34:54.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:54.390+0000 7f0222534640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T16:34:54.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:54.390+0000 7f0222534640 -1 bdev(0x55df37b43800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T16:34:54.393 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:54.390+0000 7f0222534640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T16:34:57.555 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T16:34:57.585 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:34:57.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:57.674+0000 7f63b45c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T16:34:57.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:57.674+0000 7f63b45c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T16:34:57.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:57.674+0000 7f63b45c5640 -1 bdev(0x55f833a49800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T16:34:57.677 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-17T16:34:57.674+0000 7f63b45c5640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T16:35:00.839 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T16:35:00.866 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T16:35:00.866 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:35:00.866 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T16:35:00.896 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:35:00.896 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T16:35:00.964 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:35:00.964 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T16:35:01.032 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:35:01.032 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T16:35:01.098 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:35:01.099 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T16:35:01.126 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:35:01.126 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T16:35:01.192 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:35:01.193 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T16:35:01.258 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:35:01.259 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T16:35:01.315 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T16:35:01.315 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T16:35:01.340 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-09-17T16:35:01.340 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCbr+lmig7ELxAAkmnpf3MkLgPXDtAi/r4Nng== 2024-09-17T16:35:01.340 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCer+lmnD5kDBAA2xEXjIblTiPXU4DDEb/fIA== 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQChr+lmHk/jHBAAoSaZslsTpq/o6yQRSeHKuA== 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCkr+lmwIZILRAAlyL6TFmu5IO+9igJrJmJ8g== 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCqr+lmc4+cMhAAafAF+nfs0hm6DgWLcWCXwQ== 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCur+lmmPBUFxAAHOkbX028XolsMxo6PlFohg== 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCxr+lmJDRDKBAA/bYRKlnIpWPICk2YM212ew== 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-09-17T16:35:01.341 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCbr+lmJe/TMhAAWGFWhsX8NAIIX7FadYvyCQ== 2024-09-17T16:35:01.342 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T16:35:01.435 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:35:01.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:35:01.537 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:35:01.589 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:35:01.640 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:35:01.691 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:35:01.743 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T16:35:01.797 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T16:35:01.798 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T16:35:01.824 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T16:35:01.920 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T16:35:01.945 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:35:02.000 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T16:35:02.000 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T16:35:02.001 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T16:35:02.042 INFO:tasks.ceph.mon.a:Started 2024-09-17T16:35:02.043 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph config set mgr mgr_pool false --force 2024-09-17T16:35:02.219 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T16:35:02.219 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T16:35:02.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T16:35:02.222 INFO:tasks.ceph.mgr.x:Started 2024-09-17T16:35:02.222 DEBUG:tasks.ceph:set 0 configs 2024-09-17T16:35:02.222 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T16:35:02.222 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T16:35:02.392 INFO:teuthology.orchestra.run.smithi138.stderr:adjusted tunables profile to default 2024-09-17T16:35:02.403 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T16:35:02.404 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T16:35:02.404 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:35:02.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T16:35:02.428 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:35:02.429 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T16:35:02.493 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-17T16:35:02.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T16:35:02.557 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:35:02.558 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T16:35:02.587 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:35:02.587 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T16:35:02.656 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-17T16:35:02.656 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T16:35:02.724 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 69372453-cb9e-4722-bdc6-ae38828a3e9f 0 2024-09-17T16:35:02.943 INFO:teuthology.orchestra.run.smithi165.stdout:0 2024-09-17T16:35:02.953 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 35b4cc41-f510-4862-8272-3bcf51ea9aca 1 2024-09-17T16:35:03.125 INFO:teuthology.orchestra.run.smithi165.stdout:1 2024-09-17T16:35:03.137 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new b69d2fce-7d7e-42c1-ba59-ae017110f2f5 2 2024-09-17T16:35:03.311 INFO:teuthology.orchestra.run.smithi165.stdout:2 2024-09-17T16:35:03.322 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 31ee1393-4a94-4405-8b7d-497316f6bc1f 3 2024-09-17T16:35:03.495 INFO:teuthology.orchestra.run.smithi165.stdout:3 2024-09-17T16:35:03.506 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 24593cf4-3cbc-43bc-a137-b0f41fab4122 4 2024-09-17T16:35:03.680 INFO:teuthology.orchestra.run.smithi165.stdout:4 2024-09-17T16:35:03.691 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 6b0dc9fc-b887-46ab-8057-e7c32d5a7132 5 2024-09-17T16:35:03.866 INFO:teuthology.orchestra.run.smithi165.stdout:5 2024-09-17T16:35:03.877 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T16:35:03.878 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T16:35:03.881 INFO:tasks.ceph.osd.0:Started 2024-09-17T16:35:03.881 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T16:35:03.881 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T16:35:03.884 INFO:tasks.ceph.osd.1:Started 2024-09-17T16:35:03.884 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T16:35:03.884 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T16:35:03.886 INFO:tasks.ceph.osd.2:Started 2024-09-17T16:35:03.887 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T16:35:03.887 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T16:35:03.890 INFO:tasks.ceph.osd.3:Started 2024-09-17T16:35:03.890 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T16:35:03.891 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T16:35:03.893 INFO:tasks.ceph.osd.4:Started 2024-09-17T16:35:03.893 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T16:35:03.893 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T16:35:03.897 INFO:tasks.ceph.osd.5:Started 2024-09-17T16:35:03.897 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:35:04.084 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:04.084 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":8,"fsid":"dc020b28-a66a-430c-bfac-6db0c0fa2d85","created":"2024-09-17T16:35:02.125273+0000","modified":"2024-09-17T16:35:03.861357+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T16:35:03.861357+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69372453-cb9e-4722-bdc6-ae38828a3e9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"35b4cc41-f510-4862-8272-3bcf51ea9aca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b69d2fce-7d7e-42c1-ba59-ae017110f2f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"31ee1393-4a94-4405-8b7d-497316f6bc1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"24593cf4-3cbc-43bc-a137-b0f41fab4122","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b0dc9fc-b887-46ab-8057-e7c32d5a7132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:35:04.094 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T16:35:04.095 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T16:35:04.700 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T16:35:04.859 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-17T16:35:04.859 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":8,"fsid":"dc020b28-a66a-430c-bfac-6db0c0fa2d85","created":"2024-09-17T16:35:02.125273+0000","modified":"2024-09-17T16:35:03.861357+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T16:35:03.861357+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69372453-cb9e-4722-bdc6-ae38828a3e9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"35b4cc41-f510-4862-8272-3bcf51ea9aca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b69d2fce-7d7e-42c1-ba59-ae017110f2f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"31ee1393-4a94-4405-8b7d-497316f6bc1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"24593cf4-3cbc-43bc-a137-b0f41fab4122","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6b0dc9fc-b887-46ab-8057-e7c32d5a7132","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:35:04.869 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-17T16:35:05.090 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-17T16:35:05.087+0000 7f40067dd640 -1 Falling back to public interface 2024-09-17T16:35:05.332 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-17T16:35:05.329+0000 7f8602285640 -1 Falling back to public interface 2024-09-17T16:35:05.354 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-17T16:35:05.351+0000 7f271fd20640 -1 Falling back to public interface 2024-09-17T16:35:05.566 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-17T16:35:05.563+0000 7f8ff660d640 -1 Falling back to public interface 2024-09-17T16:35:05.589 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-17T16:35:05.586+0000 7f56b1814640 -1 Falling back to public interface 2024-09-17T16:35:05.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:35:05.600+0000 7f25c2cf1640 -1 Falling back to public interface 2024-09-17T16:35:07.473 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-17T16:35:07.469+0000 7fc53b706640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-17T16:35:08.867 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-17T16:35:08.864+0000 7f40067dd640 -1 osd.3 0 log_to_monitors true 2024-09-17T16:35:09.057 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-17T16:35:09.054+0000 7f8ff660d640 -1 osd.5 0 log_to_monitors true 2024-09-17T16:35:09.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:35:09.150+0000 7f25c2cf1640 -1 osd.1 0 log_to_monitors true 2024-09-17T16:35:09.351 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-17T16:35:09.348+0000 7f8602285640 -1 osd.4 0 log_to_monitors true 2024-09-17T16:35:09.362 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-17T16:35:09.359+0000 7f56b1814640 -1 osd.0 0 log_to_monitors true 2024-09-17T16:35:09.429 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-17T16:35:09.425+0000 7f271fd20640 -1 osd.2 0 log_to_monitors true 2024-09-17T16:35:10.483 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-17T16:35:10.481+0000 7f56ad224640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T16:35:10.485 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-17T16:35:10.482+0000 7f400276c640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T16:35:10.489 INFO:tasks.ceph.osd.3.smithi165.stderr:2024-09-17T16:35:10.487+0000 7f3ffe593640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:35:10.490 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-17T16:35:10.487+0000 7f56a904b640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:35:11.199 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-17T16:35:11.196+0000 7f85fe214640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T16:35:11.201 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-17T16:35:11.198+0000 7f8ff1f1e640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T16:35:11.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:35:11.199+0000 7f25bf494640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T16:35:11.202 INFO:tasks.ceph.osd.4.smithi165.stderr:2024-09-17T16:35:11.200+0000 7f85f6033640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:35:11.205 INFO:tasks.ceph.osd.5.smithi165.stderr:2024-09-17T16:35:11.202+0000 7f8fe9d3d640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:35:11.209 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-17T16:35:11.204+0000 7f271c4c3640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T16:35:11.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:35:11.206+0000 7f25b6a9f640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:35:11.211 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-17T16:35:11.209+0000 7f2713ace640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:35:11.473 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T16:35:11.750 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-17T16:35:11.750 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":11,"fsid":"dc020b28-a66a-430c-bfac-6db0c0fa2d85","created":"2024-09-17T16:35:02.125273+0000","modified":"2024-09-17T16:35:11.479640+0000","last_up_change":"2024-09-17T16:35:11.479640+0000","last_in_change":"2024-09-17T16:35:03.861357+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69372453-cb9e-4722-bdc6-ae38828a3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":877413202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":877413202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":877413202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":877413202}]},"public_addr":"172.21.15.138:6804/877413202","cluster_addr":"172.21.15.138:6805/877413202","heartbeat_back_addr":"172.21.15.138:6807/877413202","heartbeat_front_addr":"172.21.15.138:6806/877413202","state":["exists","up"]},{"osd":1,"uuid":"35b4cc41-f510-4862-8272-3bcf51ea9aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":258902983}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":258902983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":258902983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":258902983}]},"public_addr":"172.21.15.138:6808/258902983","cluster_addr":"172.21.15.138:6809/258902983","heartbeat_back_addr":"172.21.15.138:6811/258902983","heartbeat_front_addr":"172.21.15.138:6810/258902983","state":["exists","up"]},{"osd":2,"uuid":"b69d2fce-7d7e-42c1-ba59-ae017110f2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":1957284935}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":1957284935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":1957284935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":1957284935}]},"public_addr":"172.21.15.138:6800/1957284935","cluster_addr":"172.21.15.138:6801/1957284935","heartbeat_back_addr":"172.21.15.138:6803/1957284935","heartbeat_front_addr":"172.21.15.138:6802/1957284935","state":["exists","up"]},{"osd":3,"uuid":"31ee1393-4a94-4405-8b7d-497316f6bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6800","nonce":48802958}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6801","nonce":48802958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6803","nonce":48802958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6802","nonce":48802958}]},"public_addr":"172.21.15.165:6800/48802958","cluster_addr":"172.21.15.165:6801/48802958","heartbeat_back_addr":"172.21.15.165:6803/48802958","heartbeat_front_addr":"172.21.15.165:6802/48802958","state":["exists","up"]},{"osd":4,"uuid":"24593cf4-3cbc-43bc-a137-b0f41fab4122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6804","nonce":2839896858}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6805","nonce":2839896858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6807","nonce":2839896858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6806","nonce":2839896858}]},"public_addr":"172.21.15.165:6804/2839896858","cluster_addr":"172.21.15.165:6805/2839896858","heartbeat_back_addr":"172.21.15.165:6807/2839896858","heartbeat_front_addr":"172.21.15.165:6806/2839896858","state":["exists","up"]},{"osd":5,"uuid":"6b0dc9fc-b887-46ab-8057-e7c32d5a7132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6808","nonce":3866589657}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6809","nonce":3866589657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6811","nonce":3866589657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6810","nonce":3866589657}]},"public_addr":"172.21.15.165:6808/3866589657","cluster_addr":"172.21.15.165:6809/3866589657","heartbeat_back_addr":"172.21.15.165:6811/3866589657","heartbeat_front_addr":"172.21.15.165:6810/3866589657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:35:11.761 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-17T16:35:11.761 INFO:tasks.ceph:Creating RBD pool 2024-09-17T16:35:11.762 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-17T16:35:12.486 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'rbd' created 2024-09-17T16:35:12.500 DEBUG:teuthology.orchestra.run.smithi138:> rbd --cluster ceph pool init rbd 2024-09-17T16:35:15.519 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T16:35:15.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T16:35:15.520 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T16:35:15.815 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:15.825 INFO:teuthology.orchestra.run.smithi138.stdout:[{"version":6,"timestamp":"2024-09-17T16:35:11.206785+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"7386.496800"}]}] 2024-09-17T16:35:15.826 INFO:tasks.ceph_manager:config epoch is 6 2024-09-17T16:35:15.826 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T16:35:15.826 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T16:35:15.826 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T16:35:16.156 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:16.167 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":4,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6812","nonce":3242032200}]},"active_addr":"172.21.15.138:6812/3242032200","active_change":"2024-09-17T16:35:06.465023+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":4090078284}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":4065702309}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":332208727}]}]} 2024-09-17T16:35:16.170 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T16:35:16.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T16:35:16.170 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:35:16.451 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:16.451 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":15,"fsid":"dc020b28-a66a-430c-bfac-6db0c0fa2d85","created":"2024-09-17T16:35:02.125273+0000","modified":"2024-09-17T16:35:15.494593+0000","last_up_change":"2024-09-17T16:35:11.479640+0000","last_in_change":"2024-09-17T16:35:03.861357+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-17T16:35:12.045731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69372453-cb9e-4722-bdc6-ae38828a3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":877413202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":877413202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":877413202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":877413202}]},"public_addr":"172.21.15.138:6804/877413202","cluster_addr":"172.21.15.138:6805/877413202","heartbeat_back_addr":"172.21.15.138:6807/877413202","heartbeat_front_addr":"172.21.15.138:6806/877413202","state":["exists","up"]},{"osd":1,"uuid":"35b4cc41-f510-4862-8272-3bcf51ea9aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":258902983}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":258902983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":258902983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":258902983}]},"public_addr":"172.21.15.138:6808/258902983","cluster_addr":"172.21.15.138:6809/258902983","heartbeat_back_addr":"172.21.15.138:6811/258902983","heartbeat_front_addr":"172.21.15.138:6810/258902983","state":["exists","up"]},{"osd":2,"uuid":"b69d2fce-7d7e-42c1-ba59-ae017110f2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":1957284935}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":1957284935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":1957284935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":1957284935}]},"public_addr":"172.21.15.138:6800/1957284935","cluster_addr":"172.21.15.138:6801/1957284935","heartbeat_back_addr":"172.21.15.138:6803/1957284935","heartbeat_front_addr":"172.21.15.138:6802/1957284935","state":["exists","up"]},{"osd":3,"uuid":"31ee1393-4a94-4405-8b7d-497316f6bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6800","nonce":48802958}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6801","nonce":48802958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6803","nonce":48802958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6802","nonce":48802958}]},"public_addr":"172.21.15.165:6800/48802958","cluster_addr":"172.21.15.165:6801/48802958","heartbeat_back_addr":"172.21.15.165:6803/48802958","heartbeat_front_addr":"172.21.15.165:6802/48802958","state":["exists","up"]},{"osd":4,"uuid":"24593cf4-3cbc-43bc-a137-b0f41fab4122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6804","nonce":2839896858}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6805","nonce":2839896858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6807","nonce":2839896858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6806","nonce":2839896858}]},"public_addr":"172.21.15.165:6804/2839896858","cluster_addr":"172.21.15.165:6805/2839896858","heartbeat_back_addr":"172.21.15.165:6807/2839896858","heartbeat_front_addr":"172.21.15.165:6806/2839896858","state":["exists","up"]},{"osd":5,"uuid":"6b0dc9fc-b887-46ab-8057-e7c32d5a7132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6808","nonce":3866589657}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6809","nonce":3866589657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6811","nonce":3866589657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6810","nonce":3866589657}]},"public_addr":"172.21.15.165:6808/3866589657","cluster_addr":"172.21.15.165:6809/3866589657","heartbeat_back_addr":"172.21.15.165:6811/3866589657","heartbeat_front_addr":"172.21.15.165:6810/3866589657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.348590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.191411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.418976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:09.842945+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.376091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.020253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:35:16.463 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T16:35:16.463 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:35:16.745 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:16.745 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":15,"fsid":"dc020b28-a66a-430c-bfac-6db0c0fa2d85","created":"2024-09-17T16:35:02.125273+0000","modified":"2024-09-17T16:35:15.494593+0000","last_up_change":"2024-09-17T16:35:11.479640+0000","last_in_change":"2024-09-17T16:35:03.861357+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-17T16:35:12.045731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69372453-cb9e-4722-bdc6-ae38828a3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":877413202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":877413202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":877413202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":877413202}]},"public_addr":"172.21.15.138:6804/877413202","cluster_addr":"172.21.15.138:6805/877413202","heartbeat_back_addr":"172.21.15.138:6807/877413202","heartbeat_front_addr":"172.21.15.138:6806/877413202","state":["exists","up"]},{"osd":1,"uuid":"35b4cc41-f510-4862-8272-3bcf51ea9aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":258902983}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":258902983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":258902983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":258902983}]},"public_addr":"172.21.15.138:6808/258902983","cluster_addr":"172.21.15.138:6809/258902983","heartbeat_back_addr":"172.21.15.138:6811/258902983","heartbeat_front_addr":"172.21.15.138:6810/258902983","state":["exists","up"]},{"osd":2,"uuid":"b69d2fce-7d7e-42c1-ba59-ae017110f2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":1957284935}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":1957284935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":1957284935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":1957284935}]},"public_addr":"172.21.15.138:6800/1957284935","cluster_addr":"172.21.15.138:6801/1957284935","heartbeat_back_addr":"172.21.15.138:6803/1957284935","heartbeat_front_addr":"172.21.15.138:6802/1957284935","state":["exists","up"]},{"osd":3,"uuid":"31ee1393-4a94-4405-8b7d-497316f6bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6800","nonce":48802958}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6801","nonce":48802958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6803","nonce":48802958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6802","nonce":48802958}]},"public_addr":"172.21.15.165:6800/48802958","cluster_addr":"172.21.15.165:6801/48802958","heartbeat_back_addr":"172.21.15.165:6803/48802958","heartbeat_front_addr":"172.21.15.165:6802/48802958","state":["exists","up"]},{"osd":4,"uuid":"24593cf4-3cbc-43bc-a137-b0f41fab4122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6804","nonce":2839896858}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6805","nonce":2839896858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6807","nonce":2839896858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6806","nonce":2839896858}]},"public_addr":"172.21.15.165:6804/2839896858","cluster_addr":"172.21.15.165:6805/2839896858","heartbeat_back_addr":"172.21.15.165:6807/2839896858","heartbeat_front_addr":"172.21.15.165:6806/2839896858","state":["exists","up"]},{"osd":5,"uuid":"6b0dc9fc-b887-46ab-8057-e7c32d5a7132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6808","nonce":3866589657}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6809","nonce":3866589657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6811","nonce":3866589657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6810","nonce":3866589657}]},"public_addr":"172.21.15.165:6808/3866589657","cluster_addr":"172.21.15.165:6809/3866589657","heartbeat_back_addr":"172.21.15.165:6811/3866589657","heartbeat_front_addr":"172.21.15.165:6810/3866589657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.348590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.191411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.418976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:09.842945+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.376091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.020253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:35:16.758 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T16:35:16.758 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T16:35:16.758 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T16:35:16.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T16:35:16.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T16:35:16.760 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T16:35:16.910 INFO:teuthology.orchestra.run.smithi138.stdout:47244640258 2024-09-17T16:35:16.911 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T16:35:16.912 INFO:teuthology.orchestra.run.smithi138.stdout:47244640259 2024-09-17T16:35:16.912 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T16:35:16.954 INFO:teuthology.orchestra.run.smithi138.stdout:47244640259 2024-09-17T16:35:16.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T16:35:16.955 INFO:teuthology.orchestra.run.smithi138.stdout:47244640259 2024-09-17T16:35:16.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T16:35:16.967 INFO:teuthology.orchestra.run.smithi138.stdout:47244640258 2024-09-17T16:35:16.967 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T16:35:16.968 INFO:teuthology.orchestra.run.smithi138.stdout:47244640259 2024-09-17T16:35:16.968 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T16:35:17.289 INFO:teuthology.orchestra.run.smithi138.stdout:47244640258 2024-09-17T16:35:17.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2024-09-17T16:35:17.387 INFO:teuthology.orchestra.run.smithi138.stdout:47244640257 2024-09-17T16:35:17.398 INFO:teuthology.orchestra.run.smithi138.stdout:47244640257 2024-09-17T16:35:17.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.5 2024-09-17T16:35:17.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.1 2024-09-17T16:35:17.469 INFO:teuthology.orchestra.run.smithi138.stdout:47244640258 2024-09-17T16:35:17.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2024-09-17T16:35:17.498 INFO:teuthology.orchestra.run.smithi138.stdout:47244640258 2024-09-17T16:35:17.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2024-09-17T16:35:17.528 INFO:teuthology.orchestra.run.smithi138.stdout:47244640258 2024-09-17T16:35:17.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2024-09-17T16:35:18.305 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T16:35:18.403 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T16:35:18.416 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T16:35:18.483 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T16:35:19.208 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T16:35:19.209 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T16:35:19.210 INFO:teuthology.orchestra.run.smithi138.stdout:47244640260 2024-09-17T16:35:19.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.2 2024-09-17T16:35:19.211 DEBUG:teuthology.parallel:result is None 2024-09-17T16:35:19.211 INFO:teuthology.orchestra.run.smithi138.stdout:47244640259 2024-09-17T16:35:19.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640259 for osd.5 2024-09-17T16:35:19.212 DEBUG:teuthology.parallel:result is None 2024-09-17T16:35:19.212 INFO:teuthology.orchestra.run.smithi138.stdout:47244640259 2024-09-17T16:35:19.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640259 for osd.1 2024-09-17T16:35:19.213 DEBUG:teuthology.parallel:result is None 2024-09-17T16:35:19.561 INFO:teuthology.orchestra.run.smithi138.stdout:47244640260 2024-09-17T16:35:19.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.3 2024-09-17T16:35:19.575 DEBUG:teuthology.parallel:result is None 2024-09-17T16:35:19.604 INFO:teuthology.orchestra.run.smithi138.stdout:47244640260 2024-09-17T16:35:19.606 INFO:teuthology.orchestra.run.smithi138.stdout:47244640260 2024-09-17T16:35:19.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.4 2024-09-17T16:35:19.619 DEBUG:teuthology.parallel:result is None 2024-09-17T16:35:19.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640260 for osd.0 2024-09-17T16:35:19.620 DEBUG:teuthology.parallel:result is None 2024-09-17T16:35:19.620 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T16:35:19.621 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:35:19.941 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:19.941 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-17T16:35:19.953 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-17T16:35:18.469337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162948,"kb_used_data":768,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068092,"statfs":{"total":579820584960,"available":579653726208,"internally_reserved":0,"allocated":786432,"data_stored":215260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.500105+0000","last_change":"2024-09-17T16:35:15.500105+0000","last_active":"2024-09-17T16:35:15.500105+0000","last_peered":"2024-09-17T16:35:15.500105+0000","last_clean":"2024-09-17T16:35:15.500105+0000","last_became_active":"2024-09-17T16:35:14.134094+0000","last_became_peered":"2024-09-17T16:35:14.134094+0000","last_unstale":"2024-09-17T16:35:15.500105+0000","last_undegraded":"2024-09-17T16:35:15.500105+0000","last_fullsized":"2024-09-17T16:35:15.500105+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:52.933293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037500100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.784770+0000","last_change":"2024-09-17T16:35:16.784770+0000","last_active":"2024-09-17T16:35:16.784770+0000","last_peered":"2024-09-17T16:35:16.784770+0000","last_clean":"2024-09-17T16:35:16.784770+0000","last_became_active":"2024-09-17T16:35:14.065678+0000","last_became_peered":"2024-09-17T16:35:14.065678+0000","last_unstale":"2024-09-17T16:35:16.784770+0000","last_undegraded":"2024-09-17T16:35:16.784770+0000","last_fullsized":"2024-09-17T16:35:16.784770+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:04:47.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041479400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.508716+0000","last_change":"2024-09-17T16:35:15.508716+0000","last_active":"2024-09-17T16:35:15.508716+0000","last_peered":"2024-09-17T16:35:15.508716+0000","last_clean":"2024-09-17T16:35:15.508716+0000","last_became_active":"2024-09-17T16:35:14.134117+0000","last_became_peered":"2024-09-17T16:35:14.134117+0000","last_unstale":"2024-09-17T16:35:15.508716+0000","last_undegraded":"2024-09-17T16:35:15.508716+0000","last_fullsized":"2024-09-17T16:35:15.508716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:05.162593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044059299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.155752+0000","last_change":"2024-09-17T16:35:16.155752+0000","last_active":"2024-09-17T16:35:16.155752+0000","last_peered":"2024-09-17T16:35:16.155752+0000","last_clean":"2024-09-17T16:35:16.155752+0000","last_became_active":"2024-09-17T16:35:13.496006+0000","last_became_peered":"2024-09-17T16:35:13.496006+0000","last_unstale":"2024-09-17T16:35:16.155752+0000","last_undegraded":"2024-09-17T16:35:16.155752+0000","last_fullsized":"2024-09-17T16:35:16.155752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:35.483232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000358735,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.155753+0000","last_change":"2024-09-17T16:35:16.155753+0000","last_active":"2024-09-17T16:35:16.155753+0000","last_peered":"2024-09-17T16:35:16.155753+0000","last_clean":"2024-09-17T16:35:16.155753+0000","last_became_active":"2024-09-17T16:35:13.497657+0000","last_became_peered":"2024-09-17T16:35:13.497657+0000","last_unstale":"2024-09-17T16:35:16.155753+0000","last_undegraded":"2024-09-17T16:35:16.155753+0000","last_fullsized":"2024-09-17T16:35:16.155753+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:09.210991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034153500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.512018+0000","last_change":"2024-09-17T16:35:15.509160+0000","last_active":"2024-09-17T16:35:15.512018+0000","last_peered":"2024-09-17T16:35:15.512018+0000","last_clean":"2024-09-17T16:35:15.512018+0000","last_became_active":"2024-09-17T16:35:14.065650+0000","last_became_peered":"2024-09-17T16:35:14.065650+0000","last_unstale":"2024-09-17T16:35:15.512018+0000","last_undegraded":"2024-09-17T16:35:15.512018+0000","last_fullsized":"2024-09-17T16:35:15.512018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:16.659322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000933667,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.500097+0000","last_change":"2024-09-17T16:35:15.500097+0000","last_active":"2024-09-17T16:35:15.500097+0000","last_peered":"2024-09-17T16:35:15.500097+0000","last_clean":"2024-09-17T16:35:15.500097+0000","last_became_active":"2024-09-17T16:35:14.065746+0000","last_became_peered":"2024-09-17T16:35:14.065746+0000","last_unstale":"2024-09-17T16:35:15.500097+0000","last_undegraded":"2024-09-17T16:35:15.500097+0000","last_fullsized":"2024-09-17T16:35:15.500097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:46:37.495177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038337499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.784739+0000","last_change":"2024-09-17T16:35:16.784739+0000","last_active":"2024-09-17T16:35:16.784739+0000","last_peered":"2024-09-17T16:35:16.784739+0000","last_clean":"2024-09-17T16:35:16.784739+0000","last_became_active":"2024-09-17T16:35:14.065657+0000","last_became_peered":"2024-09-17T16:35:14.065657+0000","last_unstale":"2024-09-17T16:35:16.784739+0000","last_undegraded":"2024-09-17T16:35:16.784739+0000","last_fullsized":"2024-09-17T16:35:16.784739+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:21.720866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000412882,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":131072,"data_stored":36494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":36513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":32752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":36494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":36494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":135168,"data_stored":36513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:35:19.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:35:20.234 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:20.234 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-17T16:35:20.246 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-09-17T16:35:18.469337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162948,"kb_used_data":768,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068092,"statfs":{"total":579820584960,"available":579653726208,"internally_reserved":0,"allocated":786432,"data_stored":215260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.500105+0000","last_change":"2024-09-17T16:35:15.500105+0000","last_active":"2024-09-17T16:35:15.500105+0000","last_peered":"2024-09-17T16:35:15.500105+0000","last_clean":"2024-09-17T16:35:15.500105+0000","last_became_active":"2024-09-17T16:35:14.134094+0000","last_became_peered":"2024-09-17T16:35:14.134094+0000","last_unstale":"2024-09-17T16:35:15.500105+0000","last_undegraded":"2024-09-17T16:35:15.500105+0000","last_fullsized":"2024-09-17T16:35:15.500105+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:52.933293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037500100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.784770+0000","last_change":"2024-09-17T16:35:16.784770+0000","last_active":"2024-09-17T16:35:16.784770+0000","last_peered":"2024-09-17T16:35:16.784770+0000","last_clean":"2024-09-17T16:35:16.784770+0000","last_became_active":"2024-09-17T16:35:14.065678+0000","last_became_peered":"2024-09-17T16:35:14.065678+0000","last_unstale":"2024-09-17T16:35:16.784770+0000","last_undegraded":"2024-09-17T16:35:16.784770+0000","last_fullsized":"2024-09-17T16:35:16.784770+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:04:47.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041479400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.508716+0000","last_change":"2024-09-17T16:35:15.508716+0000","last_active":"2024-09-17T16:35:15.508716+0000","last_peered":"2024-09-17T16:35:15.508716+0000","last_clean":"2024-09-17T16:35:15.508716+0000","last_became_active":"2024-09-17T16:35:14.134117+0000","last_became_peered":"2024-09-17T16:35:14.134117+0000","last_unstale":"2024-09-17T16:35:15.508716+0000","last_undegraded":"2024-09-17T16:35:15.508716+0000","last_fullsized":"2024-09-17T16:35:15.508716+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:05.162593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044059299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.155752+0000","last_change":"2024-09-17T16:35:16.155752+0000","last_active":"2024-09-17T16:35:16.155752+0000","last_peered":"2024-09-17T16:35:16.155752+0000","last_clean":"2024-09-17T16:35:16.155752+0000","last_became_active":"2024-09-17T16:35:13.496006+0000","last_became_peered":"2024-09-17T16:35:13.496006+0000","last_unstale":"2024-09-17T16:35:16.155752+0000","last_undegraded":"2024-09-17T16:35:16.155752+0000","last_fullsized":"2024-09-17T16:35:16.155752+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:35.483232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000358735,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.3","version":"13'1","reported_seq":21,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.155753+0000","last_change":"2024-09-17T16:35:16.155753+0000","last_active":"2024-09-17T16:35:16.155753+0000","last_peered":"2024-09-17T16:35:16.155753+0000","last_clean":"2024-09-17T16:35:16.155753+0000","last_became_active":"2024-09-17T16:35:13.497657+0000","last_became_peered":"2024-09-17T16:35:13.497657+0000","last_unstale":"2024-09-17T16:35:16.155753+0000","last_undegraded":"2024-09-17T16:35:16.155753+0000","last_fullsized":"2024-09-17T16:35:16.155753+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:09.210991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034153500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"15'2","reported_seq":22,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.512018+0000","last_change":"2024-09-17T16:35:15.509160+0000","last_active":"2024-09-17T16:35:15.512018+0000","last_peered":"2024-09-17T16:35:15.512018+0000","last_clean":"2024-09-17T16:35:15.512018+0000","last_became_active":"2024-09-17T16:35:14.065650+0000","last_became_peered":"2024-09-17T16:35:14.065650+0000","last_unstale":"2024-09-17T16:35:15.512018+0000","last_undegraded":"2024-09-17T16:35:15.512018+0000","last_fullsized":"2024-09-17T16:35:15.512018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:16.659322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000933667,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:15.500097+0000","last_change":"2024-09-17T16:35:15.500097+0000","last_active":"2024-09-17T16:35:15.500097+0000","last_peered":"2024-09-17T16:35:15.500097+0000","last_clean":"2024-09-17T16:35:15.500097+0000","last_became_active":"2024-09-17T16:35:14.065746+0000","last_became_peered":"2024-09-17T16:35:14.065746+0000","last_unstale":"2024-09-17T16:35:15.500097+0000","last_undegraded":"2024-09-17T16:35:15.500097+0000","last_fullsized":"2024-09-17T16:35:15.500097+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:46:37.495177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038337499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-17T16:35:16.784739+0000","last_change":"2024-09-17T16:35:16.784739+0000","last_active":"2024-09-17T16:35:16.784739+0000","last_peered":"2024-09-17T16:35:16.784739+0000","last_clean":"2024-09-17T16:35:16.784739+0000","last_became_active":"2024-09-17T16:35:14.065657+0000","last_became_peered":"2024-09-17T16:35:14.065657+0000","last_unstale":"2024-09-17T16:35:16.784739+0000","last_undegraded":"2024-09-17T16:35:16.784739+0000","last_fullsized":"2024-09-17T16:35:16.784739+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:21.720866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000412882,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":131072,"data_stored":36494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":135168,"data_stored":36513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":32752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":36494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":131072,"data_stored":36494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":135168,"data_stored":36513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:35:20.247 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T16:35:20.247 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T16:35:20.247 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T16:35:20.247 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T16:35:20.566 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:35:20.566 INFO:teuthology.orchestra.run.smithi138.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T16:35:20.578 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T16:35:20.579 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-17T16:35:20.588 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-09-17T16:35:20.589 INFO:teuthology.task.exec:Executing custom commands... 2024-09-17T16:35:20.589 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:35:20.589 DEBUG:teuthology.orchestra.run.smithi165:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.33' 2024-09-17T16:35:20.726 INFO:teuthology.orchestra.run.smithi165.stdout:{} 2024-09-17T16:35:20.727 INFO:teuthology.orchestra.run.smithi165.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-17T16:35:20.738 DEBUG:teuthology.orchestra.run.smithi165:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create test 16 16' 2024-09-17T16:35:21.516 INFO:teuthology.orchestra.run.smithi165.stderr:pool 'test' created 2024-09-17T16:35:21.532 DEBUG:teuthology.orchestra.run.smithi165:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set test size 3' 2024-09-17T16:35:22.123 INFO:teuthology.orchestra.run.smithi165.stderr:set pool 2 size to 3 2024-09-17T16:35:22.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph pg dump pgs --format=json-pretty' 2024-09-17T16:35:22.428 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-17T16:35:22.428 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-17T16:35:22.428 INFO:teuthology.orchestra.run.smithi165.stdout: "pg_ready": true, 2024-09-17T16:35:22.428 INFO:teuthology.orchestra.run.smithi165.stdout: "pg_stats": [ 2024-09-17T16:35:22.428 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.428 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.f", 2024-09-17T16:35:22.428 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.429 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.430 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.431 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.432 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.433 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.434 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.435 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.e", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.436 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.437 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.438 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.439 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.440 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.441 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.442 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.d", 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.443 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.444 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.445 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.446 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.447 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.448 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.449 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.450 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.c", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.451 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.452 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.453 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.454 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.455 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.456 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.457 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.b", 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.458 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.459 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.460 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.461 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.462 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.463 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.464 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.a", 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.465 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.466 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.467 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.468 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.469 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.470 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.471 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.472 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.9", 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.473 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.474 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.475 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.476 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.477 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.478 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.479 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.8", 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.480 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.481 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.482 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.483 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.484 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.485 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.486 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.0", 2024-09-17T16:35:22.487 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 20, 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:14.065657+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:14.065657+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.488 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:16.784739+0000", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.489 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-19T04:22:21.720866+0000", 2024-09-17T16:35:22.490 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.000412882, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.491 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.492 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.493 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: 3, 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: 3, 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.494 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 3, 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 3, 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.3", 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.495 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.496 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.497 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.498 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.499 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.500 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.501 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.1", 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.502 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 18, 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:14.065746+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:14.065746+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:15.500097+0000", 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.503 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.504 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T22:46:37.495177+0000", 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.505 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.00038337499999999998, 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.506 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.507 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.508 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: 5, 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.509 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: 5, 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 5, 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 5, 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.510 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.2", 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.511 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.512 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.513 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.514 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.515 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.516 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.517 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.518 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.2", 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "15'2", 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 22, 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:15.512018+0000", 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:15.509160+0000", 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:15.512018+0000", 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:15.512018+0000", 2024-09-17T16:35:22.519 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:15.512018+0000", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:14.065650+0000", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:14.065650+0000", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:15.512018+0000", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:15.512018+0000", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:15.512018+0000", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.520 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 2, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 2, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.521 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-19T04:26:16.659322+0000", 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.000933667, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 19, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 1, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 2, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.522 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 1, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 2, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 2, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.523 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.524 INFO:teuthology.orchestra.run.smithi165.stderr:dumped pgs 2024-09-17T16:35:22.525 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.525 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.526 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: 4, 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.527 INFO:teuthology.orchestra.run.smithi165.stdout: 4, 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 4, 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 4, 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.528 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.1", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.529 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.530 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.531 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.532 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.533 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.534 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.535 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.3", 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "13'1", 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 21, 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.536 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:13.497657+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:13.497657+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:16.155753+0000", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.537 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 1, 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 1, 2024-09-17T16:35:22.538 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T19:08:09.210991+0000", 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.539 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.00034153500000000002, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 1, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 2, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.540 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 1, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.541 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.542 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.543 INFO:teuthology.orchestra.run.smithi165.stdout: 1, 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: 5 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: 1, 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: 5 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 1, 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 1, 2024-09-17T16:35:22.544 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.0", 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.545 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.546 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.547 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.548 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.549 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.550 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.551 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.552 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.7", 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.553 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.554 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.555 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.556 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.557 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.558 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.559 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.560 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.4", 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 20, 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.561 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:13.496006+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:13.496006+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:16.155752+0000", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.562 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.563 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-19T00:30:35.483232+0000", 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.000358735, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.564 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.565 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.566 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.567 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: 1, 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: 3 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: 1, 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: 3 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.568 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 1, 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 1, 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.6", 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.569 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.570 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.571 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.572 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.573 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.574 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.575 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.576 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.5", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 20, 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.577 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:14.134117+0000", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:14.134117+0000", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:15.508716+0000", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.579 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T17:03:05.162593+0000", 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.00044059299999999997, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.580 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.581 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.582 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: 4, 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: 2 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: 4, 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: 2 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.583 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 4, 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 4, 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.584 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.5", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.585 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.586 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.587 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.588 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.589 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.590 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.591 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.6", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 20, 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:14.065678+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:14.065678+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.592 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:16.784770+0000", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.593 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.594 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-18T20:04:47.449832+0000", 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.00041479400000000001, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.595 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.596 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.597 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: 3, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: 3, 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: 0 2024-09-17T16:35:22.598 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 3, 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 3, 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.599 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "1.7", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 18, 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 15, 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "active+clean", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "2024-09-17T16:35:14.134094+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "2024-09-17T16:35:14.134094+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.600 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:15.500105+0000", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 12, 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 12, 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 13, 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:12.483533+0000", 2024-09-17T16:35:22.601 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.602 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "periodic scrub scheduled @ 2024-09-19T01:14:52.933293+0000", 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0.00037500100000000002, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.603 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.604 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.605 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [ 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: 5, 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: 2 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [ 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: 5, 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: 2 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: ], 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.606 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": 5, 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": 5, 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [ 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "start": "2", 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "length": "1" 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: { 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "pgid": "2.4", 2024-09-17T16:35:22.607 INFO:teuthology.orchestra.run.smithi165.stdout: "version": "0'0", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_seq": 0, 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "reported_epoch": 0, 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "state": "unknown", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fresh": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_change": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_active": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_peered": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_active": "0.000000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_became_peered": "0.000000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_unstale": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_undegraded": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.608 INFO:teuthology.orchestra.run.smithi165.stdout: "last_fullsized": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "mapping_epoch": 0, 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "log_start": "0'0", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_start": "0'0", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "created": 0, 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "last_epoch_clean": 0, 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "parent": "0.0", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "parent_split_bits": 0, 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub": "0'0", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub": "0'0", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "last_deep_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "last_clean_scrub_stamp": "2024-09-17T16:35:21.511068+0000", 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_scrubbed": 0, 2024-09-17T16:35:22.609 INFO:teuthology.orchestra.run.smithi165.stdout: "log_size": 0, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "log_dups_size": 0, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "ondisk_log_size": 0, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "stats_invalid": false, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "dirty_stats_invalid": false, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_stats_invalid": false, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_stats_invalid": false, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "hitset_bytes_stats_invalid": false, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "pin_stats_invalid": false, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "manifest_stats_invalid": false, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrimq_len": 0, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "last_scrub_duration": 0, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_schedule": "--", 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_duration": 0, 2024-09-17T16:35:22.610 INFO:teuthology.orchestra.run.smithi165.stdout: "objects_trimmed": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "snaptrim_duration": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "stat_sum": { 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_clones": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_object_copies": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing_on_primary": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_missing": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_degraded": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_misplaced": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_unfound": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_dirty": 0, 2024-09-17T16:35:22.611 INFO:teuthology.orchestra.run.smithi165.stdout: "num_whiteouts": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_read_kb": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_write_kb": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_scrub_errors": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_shallow_scrub_errors": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_deep_scrub_errors": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_recovered": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_recovered": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_keys_recovered": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_omap": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_hit_set_archive": 0, 2024-09-17T16:35:22.612 INFO:teuthology.orchestra.run.smithi165.stdout: "num_bytes_hit_set_archive": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_kb": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_kb": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_promote": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_high": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_flush_mode_low": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_some": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_evict_mode_full": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_pinned": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_legacy_snapsets": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_large_omap_objects": 0, 2024-09-17T16:35:22.613 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_manifest": 0, 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_bytes": 0, 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "num_omap_keys": 0, 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "num_objects_repaired": 0 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "up": [], 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "acting": [], 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "avail_no_missing": [], 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "object_location_counts": [], 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "blocked_by": [], 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "up_primary": -1, 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "acting_primary": -1, 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: "purged_snaps": [] 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-17T16:35:22.614 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-17T16:35:22.615 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-17T16:35:22.615 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-17T16:35:22.617 INFO:tasks.radosbench:Beginning radosbench... 2024-09-17T16:35:22.617 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 1048576 -p test bench 60 write --no-cleanup' 2024-09-17T16:35:22.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-09-17T16:35:22.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 1048576 for up to 60 seconds or 0 objects 2024-09-17T16:35:22.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object prefix: benchmark_data_smithi165_34272 2024-09-17T16:35:22.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:35:22.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-09-17T16:35:23.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 1037 1021 63.8091 63.8125 0.00372391 0.0155995 2024-09-17T16:35:24.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 3002 2986 93.3062 122.812 0.00375218 0.0106904 2024-09-17T16:35:25.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 16 4903 4887 101.806 118.812 0.00516822 0.00979459 2024-09-17T16:35:26.671 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 6773 6757 105.571 116.875 0.00916104 0.00945848 2024-09-17T16:35:27.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 8599 8583 107.28 114.125 0.00437176 0.00931398 2024-09-17T16:35:28.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 10320 10304 107.326 107.562 0.00978524 0.00930742 2024-09-17T16:35:29.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 11999 11983 106.983 104.938 0.00976329 0.00933474 2024-09-17T16:35:30.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 13669 13653 106.656 104.375 0.00661024 0.00936663 2024-09-17T16:35:31.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 15261 15245 105.86 99.5 0.0119329 0.00943832 2024-09-17T16:35:32.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 16 16836 16820 105.117 98.4375 0.00683277 0.00950649 2024-09-17T16:35:33.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 16 18336 18320 104.083 93.75 0.00734993 0.00960019 2024-09-17T16:35:34.680 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 19824 19808 103.159 93 0.00505986 0.00968888 2024-09-17T16:35:35.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 21315 21299 102.391 93.1875 0.00878801 0.00976032 2024-09-17T16:35:36.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 22753 22737 101.497 89.875 0.0100618 0.0098458 2024-09-17T16:35:37.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 16 24160 24144 100.593 87.9375 0.00835331 0.00993349 2024-09-17T16:35:38.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 16 25544 25528 99.7113 86.5 0.00927125 0.0100207 2024-09-17T16:35:39.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 26968 26952 99.0808 89 0.0146144 0.0100839 2024-09-17T16:35:40.672 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 28376 28360 98.4649 88 0.00871301 0.0101504 2024-09-17T16:35:41.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 29680 29664 97.5717 81.5 0.00842328 0.010242 2024-09-17T16:35:42.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:35:42.671741+0000 min lat: 0.00127296 max lat: 0.482543 avg lat: 0.0103202 2024-09-17T16:35:42.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:35:42.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 15 31007 30992 96.8428 83 0.0114477 0.0103202 2024-09-17T16:35:43.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 32359 32343 96.2517 84.4375 0.0119849 0.0103838 2024-09-17T16:35:44.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 33614 33598 95.4417 78.4375 0.0157426 0.0104712 2024-09-17T16:35:45.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 16 34899 34883 94.7836 80.3125 0.0198175 0.010543 2024-09-17T16:35:46.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 36068 36052 93.8784 73.0625 0.00678152 0.0106461 2024-09-17T16:35:47.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 37338 37322 93.298 79.375 0.0127851 0.0107127 2024-09-17T16:35:48.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 38601 38585 92.7454 78.9375 0.0150979 0.0107758 2024-09-17T16:35:49.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 39802 39786 92.0902 75.0625 0.00799212 0.0108543 2024-09-17T16:35:50.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 40983 40967 91.4373 73.8125 0.012682 0.0109311 2024-09-17T16:35:51.673 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 42184 42168 90.8723 75.0625 0.0120182 0.0109982 2024-09-17T16:35:52.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 43351 43335 90.2743 72.9375 0.0147751 0.0110722 2024-09-17T16:35:53.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 44501 44485 89.6807 71.875 0.0135653 0.0111448 2024-09-17T16:35:54.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 45581 45565 88.9874 67.5 0.0164098 0.0112317 2024-09-17T16:35:55.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 46684 46668 88.3797 68.9375 0.0134765 0.0113088 2024-09-17T16:35:56.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 16 47805 47789 87.8408 70.0625 0.0154139 0.0113786 2024-09-17T16:35:57.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 48948 48932 87.3719 71.4375 0.0166135 0.01144 2024-09-17T16:35:58.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 50018 50002 86.8025 66.875 0.0105006 0.0115138 2024-09-17T16:35:59.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 16 51143 51127 86.3566 70.3125 0.0120455 0.011575 2024-09-17T16:36:00.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 52216 52200 85.8487 67.0625 0.0157937 0.0116422 2024-09-17T16:36:01.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 53279 53263 85.3509 66.4375 0.0256048 0.0117092 2024-09-17T16:36:02.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:36:02.673277+0000 min lat: 0.00127296 max lat: 0.482543 avg lat: 0.0117694 2024-09-17T16:36:02.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:36:02.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 54373 54357 84.9264 68.375 0.0174902 0.0117694 2024-09-17T16:36:03.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 55430 55414 84.4661 66.0625 0.0210704 0.0118336 2024-09-17T16:36:04.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 56428 56412 83.94 62.375 0.00809246 0.011909 2024-09-17T16:36:05.674 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 57416 57400 83.4239 61.75 0.00591042 0.011983 2024-09-17T16:36:06.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 16 58369 58353 82.8815 59.5625 0.00835741 0.0120608 2024-09-17T16:36:07.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 59387 59371 82.4535 63.625 0.0165755 0.0121231 2024-09-17T16:36:08.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 60376 60360 82.0047 61.8125 0.0079532 0.0121895 2024-09-17T16:36:09.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 61367 61351 81.5776 61.9375 0.011242 0.0122534 2024-09-17T16:36:10.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 62309 62293 81.1045 58.875 0.0119219 0.0123245 2024-09-17T16:36:11.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 63243 63227 80.6406 58.375 0.0140255 0.0123957 2024-09-17T16:36:12.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 16 64158 64142 80.1714 57.1875 0.0127672 0.0124671 2024-09-17T16:36:13.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 65128 65112 79.7881 60.625 0.0236924 0.0125288 2024-09-17T16:36:14.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 66039 66023 79.3486 56.9375 0.0197822 0.0125973 2024-09-17T16:36:15.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 66969 66953 78.948 58.125 0.0151904 0.0126618 2024-09-17T16:36:16.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 16 67895 67879 78.5577 57.875 0.0172719 0.0127241 2024-09-17T16:36:17.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 16 68788 68772 78.1441 55.8125 0.0163296 0.0127917 2024-09-17T16:36:18.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 69707 69691 77.7743 57.4375 0.00727476 0.0128521 2024-09-17T16:36:19.675 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 16 70598 70582 77.3867 55.6875 0.00850131 0.0129164 2024-09-17T16:36:20.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 16 71461 71445 76.9824 53.9375 0.0175099 0.0129847 2024-09-17T16:36:21.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 72192 72176 76.4519 45.6875 0.0913864 0.0130617 2024-09-17T16:36:22.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:36:22.674776+0000 min lat: 0.00127296 max lat: 0.482543 avg lat: 0.0131385 2024-09-17T16:36:22.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:36:22.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 9 73055 73046 76.0838 54.375 0.0147672 0.0131385 2024-09-17T16:36:23.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 60.0152 2024-09-17T16:36:23.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total writes made: 73055 2024-09-17T16:36:23.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Write size: 65536 2024-09-17T16:36:23.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 1048576 2024-09-17T16:36:23.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 76.0797 2024-09-17T16:36:23.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Bandwidth: 18.394 2024-09-17T16:36:23.676 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max bandwidth (MB/sec): 122.812 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min bandwidth (MB/sec): 45.6875 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 1217 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 294.304 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 1965 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 731 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.0131392 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev Latency(s): 0.00932456 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.482543 2024-09-17T16:36:23.677 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.00127296 2024-09-17T16:36:23.684 DEBUG:teuthology.orchestra.run.smithi165:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -p test bench 360 rand' 2024-09-17T16:36:23.686 INFO:tasks.radosbench:joining radosbench (timing out after 11100s) 2024-09-17T16:36:23.686 INFO:teuthology.orchestra.run:waiting for 11100 2024-09-17T16:36:23.736 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:hints = 1 2024-09-17T16:36:23.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:36:23.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 0 0 0 0 0 0 - 0 2024-09-17T16:36:23.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.745+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:36:23.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.746+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:36:23.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.751+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:36:23.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.753+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:36:23.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.759+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:36:23.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.779+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:36:23.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.800+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:36:23.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.802+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:36:23.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.806+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:36:23.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.838+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:36:23.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.842+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:36:23.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:36:23.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.878+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:36:23.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.884+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:36:23.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.894+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:36:23.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.900+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:36:23.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.944+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:36:23.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.955+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:36:23.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.981+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:36:24.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:23.998+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:36:24.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.012+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:36:24.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.015+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:36:24.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.018+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:36:24.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.028+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:36:24.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.031+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:36:24.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.043+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:36:24.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.049+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:36:24.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.072+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:36:24.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.084+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:36:24.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.089+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:36:24.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.124+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:36:24.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.148+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:36:24.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.162+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:36:24.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.182+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:36:24.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.199+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:36:24.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.203+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:36:24.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.224+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:36:24.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.225+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:36:24.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.232+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:36:24.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.240+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:36:24.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.242+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:36:24.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.249+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:36:24.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.264+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:36:24.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.299+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:36:24.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.302+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:36:24.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.320+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:36:24.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.335+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:36:24.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.337+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:36:24.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.347+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:36:24.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.348+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:36:24.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.353+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:36:24.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.359+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:36:24.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.366+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:36:24.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.380+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:36:24.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.391+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:36:24.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.398+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:36:24.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.411+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:36:24.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.440+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:36:24.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.451+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:36:24.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.453+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:36:24.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.457+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:36:24.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.472+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:36:24.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.494+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:36:24.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.502+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:36:24.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.505+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:36:24.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.540+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:36:24.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.544+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:36:24.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:36:24.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.551+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:36:24.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.568+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:36:24.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.579+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:36:24.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.594+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:36:24.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.598+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:36:24.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:36:24.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.636+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:36:24.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.650+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:36:24.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:36:24.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.665+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:36:24.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.666+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:36:24.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.680+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:36:24.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.689+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:36:24.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.699+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:36:24.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:36:24.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.709+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:36:24.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.725+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:36:24.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.733+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:36:24.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 1 16 13366 13350 834.259 834.375 0.000692202 0.0011839 2024-09-17T16:36:24.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.751+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:36:24.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.757+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:36:24.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.763+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:36:24.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.782+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:36:24.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.806+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:36:24.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.808+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:36:24.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.815+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:36:24.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.852+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:36:24.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.856+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:36:24.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.858+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:36:24.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:36:24.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.875+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:36:24.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.881+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:36:24.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:36:24.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.895+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:36:24.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.901+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:36:24.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.942+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:36:24.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:36:24.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:24.948+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:36:25.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.032+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:36:25.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.039+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:36:25.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.087+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:36:25.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.091+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:36:25.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.097+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:36:25.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.115+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:36:25.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:36:25.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.140+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:36:25.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.156+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:36:25.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.162+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:36:25.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.163+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:36:25.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.185+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:36:25.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.187+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:36:25.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.194+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:36:25.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.197+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:36:25.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:36:25.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.237+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:36:25.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.237+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:36:25.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.249+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:36:25.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.253+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:36:25.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.255+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:36:25.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.263+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:36:25.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.268+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:36:25.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.276+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:36:25.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.301+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:36:25.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.331+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:36:25.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.334+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:36:25.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:36:25.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.344+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:36:25.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.353+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:36:25.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.386+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:36:25.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.395+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:36:25.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.405+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:36:25.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.420+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:36:25.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.434+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:36:25.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.451+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:36:25.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.457+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:36:25.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.458+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:36:25.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.492+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:36:25.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.493+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:36:25.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:36:25.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.521+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:36:25.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.534+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:36:25.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.555+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:36:25.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.561+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:36:25.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.565+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:36:25.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.595+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:36:25.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.611+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:36:25.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.628+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:36:25.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.631+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:36:25.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.633+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:36:25.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.639+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:36:25.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.646+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:36:25.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.646+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:36:25.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.652+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:36:25.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.685+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:36:25.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.689+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:36:25.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.694+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:36:25.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.727+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:36:25.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.731+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:36:25.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 2 16 26323 26307 821.983 809.812 0.00075853 0.00120475 2024-09-17T16:36:25.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.741+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:36:25.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.743+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:36:25.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.750+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:36:25.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.752+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:36:25.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.760+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:36:25.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.775+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:36:25.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.788+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:36:25.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.809+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:36:25.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.809+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:36:25.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.826+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:36:25.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.838+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:36:25.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.846+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:36:25.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.849+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:36:25.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.860+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:36:25.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.860+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:36:25.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.886+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:36:25.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.895+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:36:25.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.902+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:36:25.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.922+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:36:25.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.922+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:36:25.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.928+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:36:25.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:36:25.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.961+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:36:25.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.992+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:36:25.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:25.996+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:36:26.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.011+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:36:26.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.022+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:36:26.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.037+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:36:26.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.046+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:36:26.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.046+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:36:26.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.049+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:36:26.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.070+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:36:26.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.091+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:36:26.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.093+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:36:26.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.116+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:36:26.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.130+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:36:26.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.130+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:36:26.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.154+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:36:26.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.158+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:36:26.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:36:26.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.208+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:36:26.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.218+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:36:26.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.219+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:36:26.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.227+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:36:26.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.256+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:36:26.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.262+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:36:26.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:36:26.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.266+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:36:26.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.298+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:36:26.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.310+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:36:26.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.312+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:36:26.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.326+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:36:26.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.327+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:36:26.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.331+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:36:26.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.352+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:36:26.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.374+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:36:26.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.379+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:36:26.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.391+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:36:26.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.404+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:36:26.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.429+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:36:26.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.433+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:36:26.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:36:26.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.438+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:36:26.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.456+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:36:26.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.473+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:36:26.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.475+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:36:26.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.490+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:36:26.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.504+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:36:26.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.505+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:36:26.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.513+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:36:26.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.525+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:36:26.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.534+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:36:26.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.538+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:36:26.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.550+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:36:26.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.561+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:36:26.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:36:26.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.584+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:36:26.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:36:26.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.612+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:36:26.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.626+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:36:26.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.640+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:36:26.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.651+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:36:26.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.653+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:36:26.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.654+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:36:26.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:36:26.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.672+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:36:26.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.704+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:36:26.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.713+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:36:26.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.717+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:36:26.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.722+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:36:26.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 3 15 39914 39899 831.132 849.5 0.000652699 0.00119144 2024-09-17T16:36:26.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.735+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:36:26.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.789+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:36:26.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:36:26.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.806+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:36:26.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:36:26.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.822+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:36:26.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.831+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:36:26.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.850+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:36:26.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.861+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:36:26.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.875+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:36:26.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:36:26.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.888+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:36:26.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.893+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:36:26.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.899+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:36:26.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.920+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:36:26.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.933+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:36:26.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.945+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:36:26.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.945+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:36:26.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.953+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:36:26.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.984+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:36:26.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.991+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:36:27.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:26.998+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:36:27.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.014+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:36:27.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.032+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:36:27.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.033+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:36:27.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.051+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:36:27.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.058+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:36:27.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.075+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:36:27.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.106+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:36:27.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.112+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:36:27.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.112+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:36:27.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.125+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:36:27.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.136+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:27.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.162+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:36:27.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:36:27.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.164+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:36:27.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.172+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:36:27.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.194+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:36:27.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.207+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:36:27.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.216+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:36:27.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.220+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:36:27.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.248+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:36:27.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.252+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:36:27.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.265+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:27.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.269+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:36:27.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.290+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:36:27.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.296+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:36:27.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.310+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:36:27.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.314+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:36:27.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.324+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:36:27.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.334+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:36:27.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.356+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:36:27.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.356+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:36:27.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.361+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:36:27.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.366+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:36:27.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.397+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:36:27.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.398+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:36:27.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.409+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:36:27.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.422+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:36:27.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.428+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:36:27.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.435+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:36:27.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.442+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:36:27.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:36:27.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.463+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:36:27.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.468+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:36:27.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:36:27.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.493+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:36:27.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.502+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:36:27.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.511+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:36:27.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.543+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:36:27.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.553+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:36:27.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.566+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:36:27.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.588+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:36:27.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.595+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:36:27.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.598+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:36:27.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.601+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:36:27.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.615+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:36:27.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.617+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:36:27.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.660+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:36:27.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.660+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:36:27.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.681+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:36:27.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.682+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:36:27.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:36:27.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.714+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:36:27.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.716+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:36:27.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.721+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:36:27.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.723+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:36:27.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.729+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:36:27.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 4 16 53593 53577 837.05 854.875 0.019437 0.00118261 2024-09-17T16:36:27.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.745+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:36:27.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.757+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:36:27.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.776+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:36:27.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.785+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:36:27.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.789+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:36:27.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.804+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:36:27.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.804+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:36:27.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.807+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:36:27.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.830+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:36:27.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.831+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:36:27.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.839+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:36:27.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.875+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:36:27.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.892+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:36:27.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:36:27.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.903+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:36:27.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.914+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:36:27.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.915+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:36:27.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.932+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:36:27.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.932+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:36:27.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.950+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:36:27.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.964+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:36:27.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.968+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:36:27.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.988+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:36:27.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:27.997+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:36:28.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.021+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:36:28.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.032+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:36:28.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.034+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:36:28.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.035+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:36:28.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.044+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:36:28.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.063+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:36:28.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.065+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:36:28.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.075+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:36:28.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.099+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:36:28.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.109+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:36:28.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.110+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:36:28.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.114+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:36:28.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.120+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:36:28.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.136+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:36:28.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.141+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:36:28.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.151+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:36:28.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.163+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:36:28.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.169+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:36:28.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.171+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:36:28.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.179+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:36:28.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.207+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:36:28.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:36:28.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.232+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:36:28.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.234+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:36:28.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.244+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:36:28.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.245+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:36:28.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.254+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:36:28.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.271+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:36:28.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.277+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:36:28.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.316+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:36:28.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.331+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:36:28.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.341+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:36:28.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.362+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:36:28.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.366+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:36:28.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.367+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:36:28.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.386+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:36:28.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.391+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:36:28.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.400+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:36:28.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.413+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:36:28.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.417+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:36:28.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.423+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:36:28.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.424+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:36:28.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.430+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:36:28.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.444+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:36:28.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.448+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:36:28.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.481+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:36:28.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.495+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:36:28.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.518+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:36:28.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.521+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:36:28.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.524+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:36:28.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.541+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:36:28.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.566+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:36:28.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.569+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:36:28.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.590+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:36:28.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.594+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:36:28.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.602+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:28.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.609+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:36:28.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:36:28.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.621+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:36:28.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.639+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:36:28.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.642+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:36:28.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.658+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:36:28.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.660+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:36:28.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.667+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:36:28.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.684+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:36:28.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.699+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:36:28.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.710+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:36:28.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.715+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:36:28.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.729+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:36:28.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 5 16 66871 66855 835.601 829.875 0.000733216 0.00118529 2024-09-17T16:36:28.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.743+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:36:28.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.745+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:36:28.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.748+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:36:28.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.761+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:36:28.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.763+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:36:28.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.790+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:36:28.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.791+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:36:28.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.796+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:36:28.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.828+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:36:28.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.836+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:36:28.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.837+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:36:28.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.839+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:36:28.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.864+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:36:28.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:36:28.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.896+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:36:28.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.898+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:36:28.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.921+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:36:28.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.934+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:36:28.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.943+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:36:28.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.959+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:36:28.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.963+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:36:28.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.976+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:36:28.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.984+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:36:28.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:28.996+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:36:29.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.027+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:36:29.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.028+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:36:29.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.059+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:36:29.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.060+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:36:29.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.074+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:36:29.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.075+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:36:29.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.083+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:36:29.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.102+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:36:29.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.117+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:29.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.125+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:36:29.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.144+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:36:29.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.148+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:36:29.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.160+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:36:29.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.165+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:36:29.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.179+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:36:29.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.187+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:36:29.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.205+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:36:29.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.211+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:36:29.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.215+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:36:29.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.221+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:36:29.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.245+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:36:29.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.247+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:36:29.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.251+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:36:29.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.258+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:36:29.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.264+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:36:29.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.273+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:36:29.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.317+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:36:29.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.323+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:36:29.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.326+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:36:29.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.354+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:36:29.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.362+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:36:29.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.365+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:36:29.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.384+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:36:29.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.385+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:36:29.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.386+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:36:29.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.393+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:36:29.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.408+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:36:29.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.430+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:36:29.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.444+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:36:29.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.444+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:36:29.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.463+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:36:29.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:36:29.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.487+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:36:29.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.494+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:36:29.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.522+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:36:29.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.522+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:36:29.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.526+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:36:29.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.531+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:36:29.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.539+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:36:29.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.558+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:36:29.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.562+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:36:29.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.582+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:36:29.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.592+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:36:29.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.606+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:36:29.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.612+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:36:29.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.615+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:36:29.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.625+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:36:29.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.645+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:36:29.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:36:29.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.670+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:36:29.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.679+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:36:29.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.682+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:36:29.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.690+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:36:29.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.696+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:36:29.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.721+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:36:29.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.727+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:36:29.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 6 16 80248 80232 835.667 836.062 0.000857423 0.00118574 2024-09-17T16:36:29.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.737+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:36:29.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.749+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:36:29.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.750+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:36:29.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.770+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:36:29.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.771+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:36:29.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.772+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:36:29.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.783+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:36:29.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.794+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:36:29.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.801+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:36:29.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.839+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:36:29.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.852+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:36:29.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.853+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:36:29.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.885+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:36:29.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.885+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:36:29.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.895+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:36:29.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.902+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:36:29.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.913+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:36:29.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:36:29.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:29.963+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:36:30.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:36:30.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.093+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:36:30.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.121+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:36:30.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.126+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:36:30.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.159+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:36:30.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.168+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:36:30.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.181+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:36:30.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.197+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:36:30.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:36:30.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.207+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:36:30.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.214+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:36:30.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.222+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:36:30.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.231+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:36:30.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.238+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:36:30.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.266+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:36:30.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.282+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:36:30.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.292+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:36:30.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.302+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:36:30.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.326+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:36:30.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.329+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:36:30.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.349+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:36:30.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.355+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:36:30.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.355+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:36:30.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.362+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:36:30.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.372+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:36:30.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.383+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:36:30.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.400+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:36:30.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.405+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:36:30.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.408+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:36:30.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.413+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:36:30.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.448+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:36:30.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.458+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:36:30.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.465+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:36:30.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.465+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:36:30.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.477+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:36:30.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:36:30.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.490+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:36:30.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.492+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:36:30.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.504+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:36:30.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.509+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:36:30.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.527+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:36:30.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.532+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:36:30.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.569+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:36:30.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.581+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:36:30.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.587+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:36:30.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.600+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:36:30.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.600+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:36:30.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.622+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:36:30.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.626+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:36:30.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.629+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:36:30.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.638+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:36:30.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.643+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:36:30.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.659+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:36:30.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.683+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:36:30.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.692+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:36:30.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:36:30.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.708+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:36:30.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.710+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:36:30.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.720+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:36:30.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 7 16 92495 92479 825.63 765.438 0.000542511 0.00119976 2024-09-17T16:36:30.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.746+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:36:30.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.746+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:36:30.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.753+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:36:30.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.758+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:36:30.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.764+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:36:30.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.788+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:36:30.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.789+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:36:30.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.802+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:36:30.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.811+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:36:30.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.825+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:36:30.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.843+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:36:30.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.860+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:36:30.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.866+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:36:30.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.889+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:36:30.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.894+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:36:30.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.899+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:36:30.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.906+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:36:30.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:36:30.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.927+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:36:30.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.932+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:36:30.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.946+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:36:30.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.947+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:30.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.971+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:36:30.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:30.973+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:36:31.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:36:31.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.003+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:36:31.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.020+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:36:31.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.027+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:36:31.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.031+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:36:31.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.053+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:36:31.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.070+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:36:31.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:36:31.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.072+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:36:31.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.090+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:36:31.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.101+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:36:31.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.110+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:36:31.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.129+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:36:31.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.142+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:36:31.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.158+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:36:31.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.159+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:36:31.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.174+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:36:31.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.193+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:36:31.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.195+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:36:31.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.195+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:36:31.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.211+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:36:31.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.241+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:36:31.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.262+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:36:31.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.279+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:36:31.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.287+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:36:31.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.311+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:36:31.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:36:31.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.323+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:36:31.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.343+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:36:31.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.356+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:36:31.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.358+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:36:31.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.379+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:36:31.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.379+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:36:31.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.386+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:36:31.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.390+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:36:31.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.411+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:36:31.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.417+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:36:31.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.424+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:36:31.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.443+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:36:31.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.445+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:36:31.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.456+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:36:31.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.469+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:36:31.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.471+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:36:31.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.479+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:36:31.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.480+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:31.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.524+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:36:31.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.540+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:36:31.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.542+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:36:31.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.543+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:36:31.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.545+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:36:31.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:36:31.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.595+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:36:31.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.597+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:36:31.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.599+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:36:31.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.607+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:36:31.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.614+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:36:31.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.618+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:36:31.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.633+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:36:31.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.639+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:36:31.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.660+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:36:31.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.676+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:36:31.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.682+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:36:31.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.691+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:36:31.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.703+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:36:31.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.714+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:36:31.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.727+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:36:31.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.732+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:36:31.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 8 16 105767 105751 826.106 829.5 0.000735331 0.0011996 2024-09-17T16:36:31.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.742+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:36:31.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.746+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:36:31.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.759+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:36:31.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.772+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:36:31.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.778+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:36:31.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.778+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:36:31.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.815+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:36:31.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.829+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:36:31.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.829+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:36:31.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.831+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:36:31.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.841+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:36:31.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.851+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:36:31.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.884+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:31.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.885+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:36:31.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.892+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:36:31.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.903+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:36:31.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.907+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:31.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.928+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:36:31.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.930+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:36:31.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.930+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:36:31.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.945+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:36:31.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.965+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:36:31.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.991+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:36:31.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:31.992+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:36:32.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.008+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:36:32.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.009+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:36:32.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:36:32.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.043+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:36:32.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.057+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:36:32.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.058+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:36:32.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.103+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:36:32.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.119+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:36:32.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.134+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:36:32.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.153+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:36:32.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.154+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:36:32.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.177+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:36:32.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.185+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:36:32.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.186+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:36:32.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.204+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:36:32.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.206+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:36:32.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.212+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:36:32.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.214+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:36:32.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.226+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:36:32.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.247+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:36:32.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.256+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:36:32.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.289+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:36:32.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.293+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:36:32.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.327+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:36:32.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.335+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:36:32.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.343+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:36:32.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.346+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:36:32.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:36:32.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.402+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:36:32.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.417+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:36:32.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.419+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:36:32.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.435+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:36:32.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.454+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:36:32.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.460+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:36:32.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.475+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:36:32.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.480+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:36:32.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.486+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:36:32.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.496+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:36:32.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.500+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:36:32.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.510+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:32.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.523+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:36:32.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.527+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:36:32.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.550+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:36:32.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.576+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:36:32.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.577+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:36:32.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.577+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:36:32.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.583+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:36:32.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.586+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:36:32.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.608+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:36:32.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.613+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:36:32.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.620+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:36:32.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.634+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:36:32.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.638+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:36:32.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.648+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:36:32.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.676+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:36:32.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.696+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:36:32.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.698+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:36:32.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.709+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:36:32.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.734+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:36:32.737 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 9 16 119513 119497 829.759 859.125 0.00067163 0.00119445 2024-09-17T16:36:32.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.736+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:36:32.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.738+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:36:32.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.743+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:36:32.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.759+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:36:32.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.766+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:36:32.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.798+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:36:32.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.799+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:36:32.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.813+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:36:32.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.820+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:36:32.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.831+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:36:32.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.848+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:36:32.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.853+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:36:32.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.860+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:36:32.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:36:32.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.885+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:36:32.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:36:32.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.912+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:36:32.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:36:32.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.945+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:36:32.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.952+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:36:32.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.960+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:36:32.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.963+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:36:32.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.969+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:36:32.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.969+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:36:32.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:32.974+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:36:33.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.009+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:36:33.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.009+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:36:33.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.016+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:36:33.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.035+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:36:33.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.039+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:36:33.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.048+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:36:33.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.062+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:36:33.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.064+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:36:33.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:36:33.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.090+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:36:33.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:36:33.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.108+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:36:33.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.113+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:36:33.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.126+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:36:33.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.139+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:36:33.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.160+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:36:33.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.165+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:36:33.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.173+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:36:33.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.178+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:36:33.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.183+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:36:33.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.192+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:36:33.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.206+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:36:33.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.213+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:36:33.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.217+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:36:33.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.233+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:36:33.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.269+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:36:33.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.276+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:36:33.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.277+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:36:33.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.289+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:36:33.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.329+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:36:33.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.332+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:36:33.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.336+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:36:33.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.350+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:36:33.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.367+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:36:33.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.370+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:36:33.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.381+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:36:33.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.385+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:36:33.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.388+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:36:33.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.401+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:36:33.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.425+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:36:33.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.446+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:36:33.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.455+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:36:33.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.468+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:36:33.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.482+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:36:33.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.483+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:36:33.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.515+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:36:33.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:36:33.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.531+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:36:33.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.535+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:36:33.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.555+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:36:33.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.556+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:36:33.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.567+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:36:33.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.579+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:36:33.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.592+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:36:33.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.611+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:36:33.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.614+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:36:33.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.620+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:36:33.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.653+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:36:33.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.664+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:36:33.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.672+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:36:33.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.681+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:36:33.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.695+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:36:33.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.704+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:36:33.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.715+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:36:33.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.726+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:36:33.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 10 15 132948 132933 830.751 839.75 0.000542132 0.00119288 2024-09-17T16:36:33.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.737+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:36:33.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.759+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:36:33.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.773+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:36:33.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.782+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:36:33.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.788+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:36:33.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.803+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:36:33.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.808+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:36:33.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.816+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:36:33.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.823+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:36:33.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.833+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:36:33.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.854+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:36:33.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.854+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:36:33.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.857+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:36:33.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.870+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:36:33.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.885+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:36:33.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.891+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:36:33.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.903+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:36:33.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.933+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:36:33.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.938+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:36:33.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.941+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:36:33.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.961+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:36:33.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.975+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:36:33.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.975+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:36:33.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:33.994+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:36:34.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.008+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:36:34.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.022+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:36:34.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.030+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:36:34.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.037+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:36:34.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.046+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:36:34.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.048+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:36:34.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.060+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:36:34.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.074+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:36:34.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.077+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:36:34.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.102+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:36:34.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.146+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:36:34.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.150+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:36:34.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.164+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:36:34.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.176+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:36:34.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.179+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:36:34.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.205+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:36:34.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.217+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:36:34.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.218+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:36:34.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:36:34.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.219+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:36:34.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.219+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:36:34.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.254+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:36:34.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.257+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:36:34.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.271+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:36:34.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.281+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:36:34.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.306+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:36:34.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.319+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:36:34.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.322+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:36:34.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.352+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:36:34.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.358+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:36:34.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.364+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:36:34.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.369+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:36:34.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.383+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:36:34.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.391+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:36:34.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.399+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:36:34.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.407+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:36:34.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.430+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:36:34.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.437+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:36:34.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.443+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:36:34.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.446+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:36:34.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.484+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:36:34.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.485+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:36:34.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.485+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:36:34.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.496+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:36:34.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.500+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:36:34.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.515+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:36:34.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.540+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:36:34.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.568+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:36:34.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.582+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:36:34.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.589+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:36:34.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.599+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:36:34.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.618+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:36:34.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.621+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:36:34.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:36:34.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.651+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:36:34.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.661+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:36:34.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:36:34.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.688+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:36:34.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.695+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:36:34.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.707+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:36:34.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.712+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:36:34.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.722+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:36:34.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.729+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:36:34.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 11 15 146590 146575 832.734 852.625 0.001484 0.00118999 2024-09-17T16:36:34.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.773+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:36:34.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.776+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:36:34.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.801+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:36:34.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.811+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:36:34.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.816+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:36:34.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.825+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:36:34.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.832+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:36:34.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.848+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:36:34.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.855+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:36:34.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.858+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:36:34.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.863+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:36:34.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.865+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:36:34.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.907+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:36:34.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.922+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:36:34.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.927+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:36:34.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.954+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:36:34.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.963+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:36:34.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.981+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:36:34.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.983+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:36:34.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:34.985+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:36:35.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.017+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:36:35.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.021+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:36:35.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.023+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:36:35.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.024+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:36:35.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.035+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:36:35.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.063+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:36:35.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.068+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:36:35.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.083+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:36:35.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:36:35.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.096+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:36:35.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.100+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:36:35.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.111+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:36:35.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:36:35.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.133+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:36:35.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.133+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:36:35.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.159+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:36:35.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.162+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:36:35.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.163+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:36:35.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:36:35.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.190+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:36:35.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.195+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:36:35.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.235+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:36:35.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.253+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:36:35.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.253+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:36:35.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.256+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:36:35.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.264+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:36:35.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.268+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:36:35.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.296+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:36:35.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.302+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:36:35.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.321+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:36:35.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.325+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:36:35.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.329+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:36:35.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.338+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:36:35.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.358+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:36:35.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.371+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:36:35.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.384+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:36:35.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.395+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:36:35.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.410+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:36:35.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.425+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:36:35.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.425+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:36:35.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.427+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:36:35.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.441+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:36:35.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.452+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:36:35.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.470+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:36:35.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.498+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:36:35.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.508+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:36:35.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.524+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:36:35.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.526+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:36:35.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.528+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:36:35.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.554+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:36:35.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.570+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:36:35.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.580+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:36:35.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.587+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:36:35.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.598+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:36:35.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.612+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:36:35.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.618+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:36:35.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.623+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:36:35.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.627+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:36:35.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.632+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:36:35.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.641+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:36:35.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.662+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:36:35.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.676+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:36:35.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.679+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:36:35.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.686+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:36:35.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:36:35.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.707+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:36:35.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 12 16 160479 160463 835.667 868 0.000956989 0.00118593 2024-09-17T16:36:35.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.742+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:36:35.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.762+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:36:35.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.768+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:36:35.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.777+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:36:35.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.785+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:36:35.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.802+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:36:35.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:36:35.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.816+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:36:35.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.819+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:36:35.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.824+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:36:35.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.841+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:36:35.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.846+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:36:35.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.853+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:36:35.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:36:35.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.880+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:36:35.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.882+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:36:35.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.888+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:36:35.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.902+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:36:35.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.955+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:36:35.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.956+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:36:35.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.957+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:36:35.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:35.973+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:36:36.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.014+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:36:36.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.022+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:36:36.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.029+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:36:36.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.048+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:36:36.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.056+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:36:36.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.060+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:36:36.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.069+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:36:36.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.089+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:36:36.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:36:36.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.125+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:36:36.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.143+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:36:36.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.151+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:36:36.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.159+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:36:36.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.174+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:36:36.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.177+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:36:36.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.183+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:36:36.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.192+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:36:36.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.199+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:36:36.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.208+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:36:36.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.218+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:36:36.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.224+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:36:36.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.230+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:36:36.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.244+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:36:36.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.251+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:36:36.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.275+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:36:36.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.276+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:36:36.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.291+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:36:36.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.296+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:36:36.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.302+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:36:36.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.311+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:36:36.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.312+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:36:36.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.354+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:36:36.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.363+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:36:36.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.371+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:36:36.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.380+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:36.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.391+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:36:36.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.394+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:36:36.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.407+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:36:36.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:36:36.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.415+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:36:36.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.425+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:36:36.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.437+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:36:36.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.446+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:36:36.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.446+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:36:36.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.448+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:36:36.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.455+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:36:36.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.493+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:36:36.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.498+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:36:36.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.502+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:36:36.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:36:36.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.527+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:36:36.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.543+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:36:36.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.548+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:36:36.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.563+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:36:36.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.574+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:36:36.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.585+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:36:36.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.588+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:36:36.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.597+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:36:36.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.611+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:36:36.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.615+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:36:36.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.625+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:36:36.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.629+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:36:36.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.652+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:36:36.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.666+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:36:36.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.679+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:36:36.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.682+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:36:36.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.693+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:36:36.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.694+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:36:36.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.704+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:36:36.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.707+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:36:36.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.719+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:36:36.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.734+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:36:36.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 13 16 173970 173954 836.24 843.188 0.000621517 0.00118473 2024-09-17T16:36:36.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.759+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:36:36.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.764+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:36:36.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.772+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:36:36.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.774+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:36:36.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.805+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:36:36.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.810+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:36:36.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.813+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:36:36.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.815+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:36:36.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.846+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:36:36.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.857+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:36:36.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.859+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:36:36.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.876+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:36:36.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.881+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:36:36.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.903+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:36:36.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.904+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:36:36.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.914+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:36:36.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.930+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:36:36.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.939+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:36:36.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.952+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:36:36.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.968+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:36:36.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:36.991+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:36:37.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.006+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:36:37.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.025+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:36:37.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.037+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:36:37.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.040+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:36:37.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.042+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:36:37.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.047+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:36:37.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.070+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:36:37.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.076+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:36:37.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.084+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:36:37.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.093+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:36:37.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.110+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:36:37.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.112+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:36:37.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.122+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:36:37.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.140+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:36:37.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.171+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:36:37.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.182+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:36:37.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.189+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:36:37.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.207+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:36:37.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.216+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:36:37.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.237+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:36:37.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.242+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:36:37.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.258+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:36:37.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.264+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:36:37.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.275+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:36:37.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.288+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:36:37.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.292+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:36:37.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.296+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:36:37.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.317+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:36:37.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.323+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:36:37.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.323+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:36:37.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.329+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:36:37.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.336+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:36:37.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.368+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:36:37.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.403+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:36:37.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.412+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:36:37.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.413+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:36:37.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.418+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:36:37.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.425+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:36:37.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.434+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:36:37.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.441+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:36:37.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.445+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:36:37.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.455+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:36:37.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.477+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:36:37.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.483+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:36:37.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.488+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:36:37.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.490+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:36:37.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.533+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:36:37.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.534+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:36:37.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.539+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:36:37.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.564+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:36:37.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.567+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:36:37.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.590+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:36:37.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.594+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:36:37.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.604+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:36:37.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.610+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:36:37.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.613+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:36:37.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.637+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:36:37.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.639+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:36:37.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.651+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:36:37.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.657+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:36:37.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.672+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:36:37.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.674+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:36:37.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.678+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:36:37.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.691+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:36:37.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.692+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:36:37.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.703+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:36:37.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.723+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:36:37.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 14 16 187845 187829 838.445 867.188 0.000863643 0.00118187 2024-09-17T16:36:37.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:36:37.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.762+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:36:37.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.784+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:36:37.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.793+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:36:37.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.824+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:36:37.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.826+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:36:37.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.829+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:36:37.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.836+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:36:37.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.854+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:36:37.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.865+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:36:37.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:36:37.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:36:37.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.900+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:36:37.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:36:37.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.906+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:36:37.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:36:37.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.938+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:36:37.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.944+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:36:37.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.961+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:36:37.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.985+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:36:37.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.985+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:36:37.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:37.995+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:36:38.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.015+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:36:38.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.030+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:36:38.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.032+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:36:38.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.035+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:36:38.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.038+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:36:38.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.058+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:36:38.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.069+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:36:38.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.080+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:36:38.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.094+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:36:38.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.117+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:36:38.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.117+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:36:38.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.144+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:36:38.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.151+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:36:38.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.157+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:36:38.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.157+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:36:38.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.183+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:36:38.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.195+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:36:38.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.206+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:36:38.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.210+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:36:38.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.227+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:36:38.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.236+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:36:38.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.251+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:36:38.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.265+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:36:38.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.281+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:36:38.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.284+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:36:38.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.285+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:36:38.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.300+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:36:38.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.307+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:36:38.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.322+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:36:38.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.339+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:36:38.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.355+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:36:38.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.377+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:36:38.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.377+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:36:38.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.378+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:36:38.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.382+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:36:38.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.403+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:36:38.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.403+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:36:38.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.411+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:36:38.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.415+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:36:38.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.419+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:36:38.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.455+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:36:38.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.463+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:36:38.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.468+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:36:38.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:36:38.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.505+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:36:38.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.507+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:36:38.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.528+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:36:38.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.529+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:36:38.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.531+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:36:38.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.553+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:36:38.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.556+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:36:38.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.575+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:36:38.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.586+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:36:38.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.613+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:36:38.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.615+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:36:38.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.620+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:36:38.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.620+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:38.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.621+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:36:38.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.651+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:36:38.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.661+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:36:38.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.696+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:36:38.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.706+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:36:38.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.712+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:38.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.726+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:36:38.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 15 15 201586 201571 839.801 858.875 0.00137392 0.00117999 2024-09-17T16:36:38.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.745+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:36:38.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.749+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:36:38.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.767+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:36:38.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.783+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:36:38.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.801+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:36:38.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.801+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:36:38.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.810+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:36:38.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.822+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:36:38.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:36:38.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.841+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:36:38.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.851+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:36:38.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.857+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:36:38.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.859+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:36:38.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.866+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:36:38.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.882+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:36:38.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.900+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:36:38.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.914+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:36:38.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.916+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:36:38.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:36:38.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.934+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:36:38.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:38.978+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:36:39.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.000+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:36:39.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.002+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:36:39.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.004+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:36:39.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.006+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:36:39.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.028+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:36:39.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.029+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:36:39.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.048+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:36:39.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.053+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:36:39.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.086+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:36:39.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.108+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:36:39.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.130+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:36:39.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.133+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:36:39.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.144+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:36:39.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.152+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:36:39.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.160+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:36:39.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.189+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:36:39.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.192+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:36:39.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.195+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:36:39.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.202+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:36:39.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.209+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:36:39.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.235+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:36:39.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.256+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:36:39.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.261+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:36:39.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.270+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:36:39.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.298+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:36:39.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.306+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:36:39.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.315+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:36:39.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.333+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:36:39.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.355+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:36:39.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.361+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:36:39.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.361+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:36:39.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.381+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:36:39.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.391+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:36:39.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.393+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:36:39.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.411+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:36:39.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.417+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:36:39.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.436+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:36:39.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.439+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:36:39.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.456+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:36:39.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.467+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:36:39.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.469+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:36:39.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.477+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:36:39.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.489+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:36:39.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.489+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:36:39.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.495+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:36:39.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.506+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:36:39.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.513+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:36:39.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.532+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:36:39.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.534+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:36:39.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.543+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:36:39.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.549+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:36:39.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.564+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:36:39.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.566+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:36:39.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.582+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:36:39.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:36:39.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.620+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:36:39.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.623+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:36:39.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.623+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:36:39.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.648+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:36:39.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:36:39.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.660+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:36:39.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.663+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:36:39.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.704+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:36:39.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.705+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:36:39.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.731+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:36:39.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 16 15 215349 215334 841.071 860.188 0.000749675 0.00117819 2024-09-17T16:36:39.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.749+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:36:39.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.762+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:36:39.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.767+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:36:39.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.769+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:36:39.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.775+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:36:39.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.784+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:36:39.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.801+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:36:39.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.803+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:36:39.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.831+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:36:39.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.838+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:36:39.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.847+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:36:39.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.851+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:36:39.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.873+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:36:39.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.889+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:36:39.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.895+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:36:39.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.904+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:36:39.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.910+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:36:39.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.913+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:36:39.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.916+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:36:39.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.931+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:36:39.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.936+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:36:39.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.945+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:36:39.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.993+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:36:40.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:39.998+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:36:40.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.009+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:36:40.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.009+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:36:40.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.032+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:36:40.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.037+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:36:40.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.040+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:36:40.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.049+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:36:40.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:36:40.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.129+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:36:40.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:36:40.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:36:40.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.171+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:36:40.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:40.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.205+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:36:40.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.220+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:36:40.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.221+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:36:40.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.248+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:36:40.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.260+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:36:40.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.280+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:36:40.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.281+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:36:40.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.284+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:36:40.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.294+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:36:40.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.298+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:36:40.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.301+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:36:40.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.342+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:36:40.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.344+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:36:40.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.347+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:36:40.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.388+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:36:40.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.391+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:36:40.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.400+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:36:40.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.413+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:36:40.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.420+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:36:40.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.423+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:36:40.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.467+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:36:40.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.467+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:36:40.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.486+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:36:40.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.489+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:36:40.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.500+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:36:40.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.512+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:36:40.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.528+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:36:40.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.539+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:36:40.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.541+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:36:40.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:36:40.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:36:40.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.586+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:36:40.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.594+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:36:40.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.614+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:36:40.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.621+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:36:40.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.629+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:36:40.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.634+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:36:40.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.659+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:36:40.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.667+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:36:40.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.676+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:36:40.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.680+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:36:40.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.716+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:36:40.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.729+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:36:40.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 17 16 228040 228024 838.246 793.125 0.000723329 0.00118221 2024-09-17T16:36:40.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.744+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:36:40.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.745+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:36:40.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.751+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:36:40.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.766+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:36:40.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.775+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:36:40.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.779+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:36:40.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.789+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:36:40.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.804+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:36:40.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.809+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:36:40.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.815+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:36:40.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.817+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:36:40.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.822+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:36:40.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.850+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:36:40.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.856+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:36:40.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.876+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:36:40.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.893+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:36:40.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.893+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:36:40.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.907+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:36:40.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.908+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:36:40.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.927+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:36:40.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.944+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:36:40.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.947+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:36:40.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.961+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:36:40.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:40.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.968+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:36:41.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:40.997+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:36:41.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.008+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:36:41.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.017+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:36:41.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.019+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:36:41.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.048+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:36:41.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.066+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:36:41.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.078+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:36:41.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.097+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:36:41.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.104+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:36:41.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.125+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:36:41.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.127+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:36:41.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.133+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:36:41.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.165+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:36:41.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.170+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:36:41.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.174+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:36:41.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.178+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:36:41.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.187+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:36:41.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.191+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:36:41.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:36:41.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.233+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:36:41.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.240+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:36:41.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.249+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:36:41.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.255+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:36:41.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.264+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:36:41.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.266+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:36:41.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.297+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:36:41.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.314+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:36:41.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.315+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:36:41.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.326+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:36:41.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.341+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:36:41.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.352+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:36:41.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.373+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:36:41.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.386+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:36:41.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.396+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:36:41.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.412+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:36:41.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.414+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:36:41.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.423+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:36:41.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.432+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:36:41.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.447+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:36:41.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.463+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:36:41.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.473+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:36:41.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.483+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:36:41.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.503+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:36:41.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.520+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:36:41.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.524+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:36:41.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.556+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:36:41.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.559+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:36:41.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.560+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:36:41.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.567+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:36:41.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.588+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:36:41.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.598+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:36:41.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:36:41.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:36:41.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.630+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:36:41.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.631+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:36:41.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.642+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:36:41.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.650+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:36:41.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.655+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:36:41.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.673+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:36:41.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.693+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:36:41.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.703+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:36:41.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.714+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:36:41.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.718+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:36:41.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 18 16 241678 241662 839.028 852.375 0.000871498 0.00118103 2024-09-17T16:36:41.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.756+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:36:41.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.756+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:36:41.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.762+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:36:41.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.767+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:36:41.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.771+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:36:41.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.783+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:36:41.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.812+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:36:41.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.819+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:36:41.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.831+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:36:41.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.833+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:36:41.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.838+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:36:41.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.858+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:36:41.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.859+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:36:41.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.866+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:36:41.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.871+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:36:41.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.904+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:36:41.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.922+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:36:41.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.935+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:36:41.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.944+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:36:41.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.947+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:36:41.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.953+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:36:41.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.990+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:36:41.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.992+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:36:42.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:41.999+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:36:42.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.025+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:36:42.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.026+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:36:42.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.039+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:36:42.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.039+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:36:42.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.042+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:36:42.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.054+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:36:42.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.098+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:36:42.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.098+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:36:42.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.102+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:36:42.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.124+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:36:42.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.132+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:36:42.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.133+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:36:42.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.151+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:36:42.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.161+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:36:42.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.164+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:36:42.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:36:42.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.196+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:36:42.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.204+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:36:42.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.227+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:36:42.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.229+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:36:42.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.233+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:36:42.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.236+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:36:42.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.252+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:36:42.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.262+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:36:42.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.266+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:36:42.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.282+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:36:42.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.287+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:36:42.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.310+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:36:42.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.322+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:36:42.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.332+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:36:42.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.333+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:36:42.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.347+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:36:42.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.361+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:36:42.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.393+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:36:42.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.394+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:36:42.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.409+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:36:42.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.432+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:36:42.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.439+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:36:42.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.451+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:36:42.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.456+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:36:42.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.456+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:36:42.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.476+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:36:42.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.478+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:36:42.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.490+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:36:42.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.500+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:36:42.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.503+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:36:42.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.523+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:36:42.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.548+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:36:42.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.586+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:36:42.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.592+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:36:42.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.600+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:36:42.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.613+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:36:42.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.614+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:36:42.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.616+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:36:42.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.618+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:36:42.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.636+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:36:42.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.649+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:36:42.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.671+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:36:42.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.687+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:36:42.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.700+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:36:42.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.718+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:36:42.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.722+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:36:42.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.724+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:36:42.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:36:42.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 19 16 255211 255195 839.381 845.812 0.000980845 0.00118045 2024-09-17T16:36:42.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.743+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:36:42.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.746+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:36:42.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.747+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:36:42.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.757+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:42.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.778+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:36:42.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.785+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:36:42.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.790+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:36:42.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.792+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:36:42.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.815+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:36:42.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.831+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:36:42.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.833+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:36:42.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.842+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:36:42.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:36:42.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.888+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:36:42.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.897+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:36:42.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.899+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:36:42.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.914+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:36:42.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.929+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:36:42.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.931+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:36:42.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.937+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:36:42.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.955+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:36:42.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.970+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:36:42.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:42.977+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:36:43.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.000+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:36:43.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.002+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:36:43.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.007+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:36:43.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.023+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:36:43.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.039+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:36:43.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.048+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:36:43.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.059+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:36:43.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.067+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:36:43.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.072+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:36:43.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.082+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:36:43.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.096+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:36:43.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.116+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:36:43.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.132+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:36:43.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.134+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:36:43.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.139+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:36:43.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.150+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:36:43.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.159+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:36:43.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.171+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:36:43.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.200+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:36:43.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.201+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:36:43.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.201+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:36:43.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.218+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:36:43.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.220+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:36:43.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.224+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:36:43.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.269+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:36:43.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.270+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:36:43.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.275+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:36:43.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.277+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:36:43.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.306+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:36:43.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.307+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:36:43.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:36:43.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.316+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:36:43.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.332+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:36:43.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.336+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:36:43.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.346+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:36:43.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.350+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:36:43.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:36:43.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.385+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:36:43.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.403+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:36:43.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.404+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:36:43.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.409+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:36:43.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.417+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:36:43.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.433+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:36:43.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.437+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:36:43.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.443+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:36:43.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.451+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:36:43.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.470+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:36:43.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.489+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:36:43.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.493+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:36:43.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.496+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:36:43.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.503+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:36:43.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.514+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:36:43.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.527+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:36:43.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:36:43.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.536+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:36:43.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.547+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:36:43.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.558+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:36:43.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:36:43.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.602+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:36:43.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.631+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:36:43.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.633+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:36:43.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.634+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:36:43.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.644+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:36:43.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.655+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:36:43.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.672+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:36:43.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.699+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:36:43.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.708+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:36:43.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.719+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:36:43.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.721+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:36:43.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.730+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:36:43.738 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:36:43.737613+0000 min lat: 0.000231444 max lat: 0.106995 avg lat: 0.001181 2024-09-17T16:36:43.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:36:43.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 20 16 268545 268529 839.077 833.375 0.000686221 0.001181 2024-09-17T16:36:43.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.766+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:36:43.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.774+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:36:43.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.780+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:36:43.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.784+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:36:43.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.811+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:36:43.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.844+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:36:43.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.844+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:36:43.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.850+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:36:43.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.857+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:36:43.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.906+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:36:43.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.924+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:36:43.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.927+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:36:43.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.941+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:36:43.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.942+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:36:43.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.944+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:36:43.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.970+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:36:43.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.971+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:36:43.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.991+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:36:43.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:43.995+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:36:44.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.005+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:36:44.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.013+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:36:44.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.027+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:36:44.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.029+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:36:44.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.039+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:36:44.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.061+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:36:44.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.070+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:36:44.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.075+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:36:44.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.085+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:36:44.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.106+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:36:44.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.114+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:36:44.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.130+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:36:44.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.145+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:36:44.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.159+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:36:44.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.161+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:36:44.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.176+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:36:44.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.178+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:36:44.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.181+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:36:44.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.190+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:36:44.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.199+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:36:44.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.244+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:36:44.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.259+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:36:44.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.264+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:36:44.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.265+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:36:44.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.268+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:36:44.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.306+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:36:44.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.311+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:36:44.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.314+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:36:44.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.358+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:36:44.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.359+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:36:44.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.363+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:36:44.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.374+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:36:44.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.386+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:36:44.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:36:44.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.416+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:36:44.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.427+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:36:44.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.444+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:36:44.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.448+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:36:44.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.453+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:36:44.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.471+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:36:44.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.473+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:36:44.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.480+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:36:44.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.485+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:36:44.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.502+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:36:44.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.517+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:36:44.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.522+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:36:44.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.532+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:36:44.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.563+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:36:44.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.570+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:36:44.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.582+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:36:44.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.598+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:36:44.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.602+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:36:44.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.606+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:36:44.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.614+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:36:44.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.632+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:36:44.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.642+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:36:44.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:36:44.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.652+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:36:44.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.679+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:36:44.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.686+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:36:44.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.713+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:36:44.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.717+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:36:44.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.725+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:36:44.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 21 16 282356 282340 840.222 863.188 0.00101858 0.00117941 2024-09-17T16:36:44.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.753+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:36:44.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.758+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:36:44.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.762+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:36:44.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.789+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:36:44.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.796+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:36:44.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.796+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:36:44.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.803+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:36:44.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.806+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:36:44.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.814+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:36:44.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:36:44.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.830+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:36:44.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.862+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:36:44.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.867+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:36:44.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.872+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:36:44.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.896+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:36:44.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.903+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:36:44.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.912+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:36:44.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.917+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:36:44.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.929+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:36:44.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.941+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:36:44.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.946+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:36:44.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.964+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:36:44.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.977+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:36:44.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:36:44.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:44.991+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:36:45.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.002+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:36:45.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.021+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:36:45.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.022+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:36:45.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.025+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:36:45.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.039+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:36:45.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.055+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:36:45.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.065+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:36:45.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.070+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:36:45.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.087+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:36:45.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.094+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:36:45.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.099+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:36:45.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.107+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:36:45.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.121+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:36:45.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.133+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:36:45.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.135+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:36:45.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.144+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:36:45.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.172+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:36:45.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.181+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:36:45.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.184+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:36:45.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.206+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:36:45.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.208+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:36:45.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.225+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:36:45.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.239+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:36:45.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.241+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:36:45.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.257+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:36:45.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.268+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:36:45.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.269+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:36:45.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.290+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:36:45.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.294+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:36:45.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.295+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:36:45.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.312+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:36:45.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.321+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:36:45.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.329+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:36:45.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.348+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:36:45.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.359+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:36:45.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.359+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:36:45.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.372+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:36:45.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.377+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:36:45.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.415+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:36:45.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.415+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:36:45.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.425+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:36:45.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:36:45.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.453+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:36:45.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.463+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:36:45.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.479+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:36:45.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.486+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:45.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.513+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:36:45.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.524+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:36:45.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.525+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:36:45.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.545+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:36:45.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.554+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:36:45.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.578+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:36:45.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.594+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:36:45.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.604+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:36:45.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:36:45.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.618+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:36:45.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.633+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:36:45.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.633+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:36:45.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.633+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:36:45.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.638+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:36:45.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.659+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:36:45.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.673+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:36:45.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.691+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:36:45.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.694+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:36:45.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.706+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:36:45.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.720+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:36:45.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.727+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:36:45.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 22 16 296131 296115 841.155 860.938 0.000780744 0.00117806 2024-09-17T16:36:45.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.740+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:36:45.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.746+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:36:45.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.758+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:36:45.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.770+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:36:45.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.787+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:36:45.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.788+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:36:45.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.818+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:36:45.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.822+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:36:45.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.841+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:36:45.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.851+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:36:45.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:36:45.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:36:45.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.897+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:36:45.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.908+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:36:45.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.918+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:36:45.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.926+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:36:45.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.930+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:36:45.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.945+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:36:45.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.969+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:36:45.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.980+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:36:45.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.984+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:36:45.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.991+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:36:46.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:45.998+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:36:46.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.004+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:36:46.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.004+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:36:46.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.018+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:36:46.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.053+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:36:46.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.056+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:36:46.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.084+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:36:46.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.104+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:36:46.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.107+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:36:46.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.112+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:36:46.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.128+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:36:46.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.130+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:36:46.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.136+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:36:46.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.153+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:36:46.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.170+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:36:46.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.179+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:36:46.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.205+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:36:46.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.211+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:36:46.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.216+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:36:46.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.223+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:36:46.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.226+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:36:46.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.244+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:36:46.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.258+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:36:46.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.271+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:36:46.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.273+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:36:46.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.301+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:36:46.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.310+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:36:46.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.312+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:46.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.314+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:36:46.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.342+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:36:46.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.351+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:36:46.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.351+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:36:46.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.364+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:36:46.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.370+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:36:46.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.406+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:36:46.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.414+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:36:46.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.423+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:36:46.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.424+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:36:46.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.453+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:36:46.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.462+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:36:46.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.472+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:36:46.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.479+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:36:46.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.485+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:36:46.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.487+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:36:46.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.528+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:36:46.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.533+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:36:46.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.537+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:36:46.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.553+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:36:46.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:36:46.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.577+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:36:46.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.583+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:36:46.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.597+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:36:46.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.604+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:36:46.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.615+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:36:46.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.618+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:36:46.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.655+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:36:46.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.656+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:36:46.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.671+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:36:46.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.673+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:36:46.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.681+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:36:46.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.689+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:36:46.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.699+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:36:46.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.713+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:36:46.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.721+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:36:46.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.724+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:36:46.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.724+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:36:46.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 23 15 310016 310001 842.314 867.875 0.000618783 0.00117627 2024-09-17T16:36:46.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.751+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:36:46.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.759+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:36:46.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.759+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:36:46.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.771+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:36:46.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.784+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:36:46.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.804+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:36:46.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.817+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:36:46.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.818+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:36:46.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.822+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:36:46.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.847+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:36:46.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.875+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:36:46.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.877+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:36:46.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.880+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:36:46.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.881+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:36:46.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.901+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:36:46.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.917+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:36:46.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.926+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:36:46.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.959+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:36:46.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.964+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:36:46.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.970+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:36:46.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.980+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:36:47.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:46.998+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:36:47.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.001+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:36:47.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.007+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:36:47.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.014+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:36:47.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.022+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:36:47.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.046+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:36:47.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.052+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:36:47.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.068+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:36:47.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.069+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:36:47.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.080+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:36:47.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.091+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:36:47.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.094+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:36:47.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.094+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:36:47.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.095+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:36:47.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.124+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:36:47.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.129+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:36:47.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.149+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:36:47.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.150+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:36:47.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.156+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:36:47.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.164+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:36:47.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.181+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:36:47.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.204+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:36:47.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.225+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:36:47.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.232+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:36:47.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.232+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:36:47.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.250+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:36:47.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.272+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:36:47.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.289+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:36:47.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.290+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:36:47.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.295+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:36:47.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.295+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:36:47.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.303+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:36:47.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.323+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:36:47.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.323+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:36:47.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.363+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:36:47.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.364+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:36:47.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.372+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:36:47.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.383+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:36:47.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:36:47.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.405+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:36:47.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.407+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:36:47.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.417+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:36:47.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.442+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:36:47.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.448+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:36:47.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.451+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:36:47.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.460+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:36:47.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.472+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:36:47.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.513+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:36:47.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.532+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:36:47.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.542+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:36:47.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.555+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:36:47.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:36:47.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.577+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:36:47.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.584+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:36:47.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.594+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:36:47.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.597+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:36:47.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.614+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:36:47.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.617+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:36:47.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.636+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:36:47.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.650+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:36:47.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.653+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:36:47.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.665+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:36:47.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.675+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:36:47.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.720+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:36:47.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.724+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:36:47.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 24 16 323668 323652 842.764 853.188 0.000780139 0.00117586 2024-09-17T16:36:47.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.737+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:36:47.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.742+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:36:47.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.754+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:36:47.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.757+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:36:47.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.764+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:36:47.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.777+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:36:47.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.794+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:36:47.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.814+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:36:47.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.832+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:36:47.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.835+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:36:47.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.835+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:36:47.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.849+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:36:47.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.872+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:36:47.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.896+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:47.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.898+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:36:47.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.903+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:36:47.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.917+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:36:47.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.937+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:36:47.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.942+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:36:47.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.955+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:36:47.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.961+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:36:47.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.975+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:36:47.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.984+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:36:48.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:47.998+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:36:48.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.006+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:36:48.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.010+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:36:48.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.011+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:36:48.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.021+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:36:48.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:36:48.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.043+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:36:48.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.047+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:36:48.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.074+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:36:48.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.077+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:36:48.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.091+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:36:48.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.133+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:36:48.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.153+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:36:48.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.162+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:36:48.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.172+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:36:48.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.183+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:36:48.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.214+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:36:48.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.214+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:36:48.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.215+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:36:48.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.216+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:36:48.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.252+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:36:48.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.253+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:48.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.262+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:36:48.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.268+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:36:48.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.277+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:36:48.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.296+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:36:48.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:36:48.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.349+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:36:48.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.368+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:36:48.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.376+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:36:48.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.377+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:36:48.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.396+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:36:48.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.410+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:36:48.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.413+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:36:48.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.424+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:36:48.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.427+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:36:48.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.443+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:36:48.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.463+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:36:48.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.485+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:36:48.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.495+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:36:48.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.498+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:36:48.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.522+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:36:48.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.522+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:36:48.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.543+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:36:48.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.548+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:36:48.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.548+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:36:48.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.568+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:36:48.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.581+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:36:48.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.598+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:36:48.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.619+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:36:48.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.620+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:36:48.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.629+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:36:48.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.631+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:36:48.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.649+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:48.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.659+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:36:48.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.669+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:36:48.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.680+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:36:48.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.697+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:36:48.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.698+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:36:48.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.714+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:36:48.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.732+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:36:48.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 25 16 337381 337365 843.334 857.062 0.0005062 0.00117495 2024-09-17T16:36:48.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.741+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:36:48.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.755+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:36:48.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.766+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:36:48.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.768+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:36:48.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.793+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:36:48.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.822+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:36:48.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.829+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:36:48.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.845+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:36:48.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.851+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:36:48.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.870+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:36:48.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.873+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:36:48.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.888+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:36:48.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.910+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:36:48.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.917+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:36:48.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.925+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:36:48.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.928+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:36:48.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.932+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:36:48.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.957+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:36:48.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:36:48.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.968+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:36:48.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.973+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:36:48.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:48.976+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:36:49.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:36:49.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.022+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:36:49.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.028+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:36:49.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.030+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:36:49.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.041+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:36:49.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.043+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:36:49.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.068+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:36:49.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.077+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:36:49.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.087+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:36:49.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:36:49.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.125+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:36:49.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.126+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:36:49.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.156+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:36:49.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.164+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:36:49.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.165+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:36:49.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.167+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:36:49.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.175+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:36:49.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.196+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:36:49.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.223+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:36:49.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.235+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:36:49.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.236+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:36:49.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.237+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:36:49.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.262+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:36:49.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.275+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:36:49.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.285+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:36:49.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.288+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:36:49.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.299+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:36:49.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.326+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:36:49.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:36:49.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.359+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:36:49.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.367+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:36:49.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.369+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:36:49.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:36:49.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.412+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:36:49.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:36:49.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.453+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:36:49.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.462+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:36:49.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.469+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:36:49.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.483+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:36:49.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.499+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:36:49.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.501+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:36:49.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.510+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:36:49.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.518+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:36:49.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.555+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:36:49.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.556+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:36:49.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.579+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:36:49.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.581+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:36:49.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.588+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:36:49.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.591+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:36:49.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.591+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:49.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.615+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:36:49.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.634+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:36:49.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.653+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:36:49.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.659+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:36:49.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.666+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:36:49.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.667+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:36:49.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.675+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:36:49.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.692+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:36:49.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.704+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:36:49.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.718+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:36:49.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.723+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:36:49.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 26 16 351191 351175 844.092 863.125 0.00120145 0.00117391 2024-09-17T16:36:49.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.750+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:36:49.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.760+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:36:49.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.763+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:36:49.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.776+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:36:49.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.777+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:36:49.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.792+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:36:49.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.810+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:36:49.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.812+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:36:49.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.814+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:36:49.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.817+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:36:49.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.822+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:36:49.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.834+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:36:49.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.856+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:36:49.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.863+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:36:49.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:36:49.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.884+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:36:49.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.909+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:36:49.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.919+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:36:49.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.921+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:36:49.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.949+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:36:49.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.957+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:36:49.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.964+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:36:49.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.971+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:36:49.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:49.996+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:36:50.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.014+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:36:50.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.025+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:36:50.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.042+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:36:50.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.050+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:36:50.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.055+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:36:50.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.068+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:36:50.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.086+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:36:50.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.094+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:36:50.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.109+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:36:50.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.110+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:36:50.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.116+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:36:50.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.128+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:36:50.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.147+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:36:50.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.150+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:36:50.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.171+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:36:50.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.172+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:36:50.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.175+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:36:50.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.202+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:36:50.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.206+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:36:50.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:36:50.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.219+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:36:50.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.221+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:36:50.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.238+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:36:50.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.252+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:36:50.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.257+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:36:50.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.268+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:36:50.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.276+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:36:50.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.303+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:36:50.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.306+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:36:50.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.313+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:36:50.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.320+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:36:50.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.324+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:36:50.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.337+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:36:50.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.358+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:36:50.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.372+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:36:50.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.375+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:36:50.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.388+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:36:50.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:36:50.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.419+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:36:50.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.428+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:36:50.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.439+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:36:50.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.452+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:36:50.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.458+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:36:50.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.478+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:36:50.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.479+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:36:50.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.518+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:36:50.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.532+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:36:50.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.541+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:36:50.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.543+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:36:50.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.544+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:36:50.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.554+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:36:50.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.583+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:36:50.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.584+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:36:50.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.587+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:36:50.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.591+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:36:50.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.597+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:36:50.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.620+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:36:50.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.648+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:36:50.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.674+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:36:50.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.685+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:36:50.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.692+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:36:50.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.700+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:36:50.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.713+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:36:50.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.717+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:36:50.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 27 16 365168 365152 845.181 873.562 0.00135857 0.00117246 2024-09-17T16:36:50.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.740+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:36:50.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.742+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:36:50.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.757+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:36:50.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.764+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:36:50.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.765+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:36:50.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.783+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:36:50.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.801+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:36:50.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.801+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:36:50.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.810+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:36:50.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.832+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:36:50.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.840+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:36:50.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.850+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:36:50.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.858+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:36:50.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.859+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:36:50.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.882+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:36:50.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.886+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:36:50.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.892+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:36:50.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.916+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:36:50.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.919+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:36:50.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.933+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:36:50.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.938+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:36:50.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.943+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:36:50.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.945+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:36:50.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.988+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:36:50.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:50.993+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:36:51.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.015+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:36:51.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.021+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:36:51.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.025+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:36:51.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.040+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:36:51.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.044+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:36:51.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:36:51.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.086+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:36:51.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.096+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:36:51.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.110+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:36:51.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.111+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:36:51.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.112+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:36:51.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.121+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:36:51.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.143+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:36:51.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.157+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:36:51.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.175+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:36:51.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.183+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:36:51.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.191+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:36:51.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.192+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:36:51.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.218+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:36:51.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.226+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:36:51.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.237+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:36:51.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.243+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:36:51.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.246+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:36:51.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.267+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:36:51.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.270+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:36:51.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.290+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:36:51.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.297+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:36:51.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.338+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:36:51.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.341+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:36:51.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.348+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:36:51.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.358+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:36:51.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.388+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:36:51.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.391+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:36:51.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.398+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:36:51.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.410+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:36:51.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.414+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:36:51.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.418+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:36:51.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.433+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:36:51.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.450+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:36:51.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.467+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:36:51.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.471+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:36:51.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:36:51.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.502+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:36:51.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.509+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:36:51.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.517+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:36:51.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.538+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:36:51.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.539+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:36:51.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.551+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:36:51.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.564+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:36:51.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.590+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:36:51.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.596+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:36:51.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.617+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:36:51.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.620+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:36:51.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.635+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:36:51.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.643+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:36:51.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.668+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:36:51.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.696+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:36:51.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.703+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:36:51.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.709+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:36:51.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 28 16 379242 379226 846.407 879.625 0.000571181 0.00117074 2024-09-17T16:36:51.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.740+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:36:51.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.762+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:36:51.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.774+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:36:51.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.781+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:36:51.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.781+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:36:51.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.782+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:36:51.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.816+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:36:51.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.817+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:36:51.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.822+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:36:51.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.832+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:36:51.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.850+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:36:51.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:36:51.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.868+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:36:51.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.879+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:36:51.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.894+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:36:51.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.895+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:36:51.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.899+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:36:51.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.912+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:36:51.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.921+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:36:51.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.927+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:36:51.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.953+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:36:51.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.953+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:36:51.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.960+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:36:51.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.987+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:36:51.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:51.988+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:36:52.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.000+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:36:52.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.006+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:36:52.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.007+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:36:52.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.010+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:36:52.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.025+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:36:52.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.038+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:36:52.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.060+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:36:52.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.088+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:36:52.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.093+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:36:52.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.098+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:36:52.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.104+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:36:52.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.139+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:36:52.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.145+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:36:52.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.155+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:36:52.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.156+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:36:52.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.158+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:36:52.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.168+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:36:52.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.170+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:36:52.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.186+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:36:52.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.214+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:36:52.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.227+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:36:52.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.230+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:36:52.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.236+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:36:52.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.250+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:36:52.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.257+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:36:52.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.275+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:36:52.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.283+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:36:52.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.293+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:36:52.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.307+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:36:52.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.322+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:36:52.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.331+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:36:52.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.333+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:36:52.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.349+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:36:52.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.351+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:36:52.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.354+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:36:52.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.369+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:36:52.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.376+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:36:52.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.376+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:36:52.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.394+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:36:52.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.395+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:36:52.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.405+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:36:52.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.415+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:36:52.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.445+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:36:52.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.461+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:36:52.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.475+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:36:52.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.490+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:36:52.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.492+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:36:52.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.495+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:36:52.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.496+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:36:52.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.513+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:36:52.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.514+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:36:52.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.523+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:36:52.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.544+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:36:52.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.555+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:36:52.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.577+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:36:52.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.577+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:36:52.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.594+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:36:52.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.594+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:36:52.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.597+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:36:52.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.607+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:36:52.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.648+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:36:52.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.650+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:36:52.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.666+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:36:52.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.672+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:36:52.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.692+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:36:52.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.694+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:36:52.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.709+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:36:52.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.728+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:36:52.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:36:52.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 29 16 393055 393039 846.988 863.312 0.00231192 0.00116988 2024-09-17T16:36:52.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.749+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:36:52.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.756+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:36:52.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.766+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:36:52.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.767+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:36:52.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.789+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:36:52.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.792+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:36:52.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.796+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:36:52.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.804+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:36:52.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.821+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:36:52.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.828+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:36:52.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.834+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:36:52.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.843+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:36:52.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.863+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:36:52.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.864+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:36:52.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.885+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:36:52.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.886+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:36:52.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.891+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:36:52.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.892+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:36:52.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.906+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:36:52.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.911+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:36:52.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.916+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:36:52.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.925+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:36:52.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.933+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:36:52.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.937+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:36:52.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.968+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:36:52.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.973+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:36:52.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.992+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:36:53.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:52.998+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:36:53.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.010+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:36:53.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.012+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:36:53.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.039+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:36:53.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.045+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:36:53.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.063+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:36:53.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.070+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:36:53.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.082+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:36:53.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.085+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:36:53.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.094+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:36:53.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.130+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:36:53.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.136+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:36:53.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.151+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:36:53.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.164+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:36:53.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.169+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:36:53.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.172+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:36:53.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.179+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:36:53.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.184+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:36:53.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.210+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:36:53.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.220+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:36:53.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.232+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:36:53.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.258+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:36:53.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.272+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:36:53.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:36:53.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.300+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:36:53.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.302+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:36:53.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.312+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:36:53.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.312+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:36:53.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.332+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:36:53.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.343+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:36:53.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.364+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:36:53.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.376+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:36:53.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.389+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:36:53.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.390+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:36:53.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.400+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:36:53.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.404+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:36:53.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.412+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:36:53.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.416+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:36:53.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.427+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:36:53.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.433+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:36:53.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.436+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:36:53.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.455+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:36:53.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.482+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:36:53.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.486+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:36:53.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.504+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:36:53.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.513+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:36:53.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.522+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:36:53.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.524+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:36:53.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.565+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:36:53.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.568+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:36:53.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.570+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:36:53.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.609+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:36:53.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.625+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:36:53.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.628+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:36:53.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.629+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:36:53.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.631+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:36:53.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.641+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:36:53.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.659+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:36:53.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.675+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:36:53.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.681+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:36:53.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.685+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:36:53.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.727+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:36:53.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.734+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:36:53.739 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 30 16 406938 406922 847.675 867.688 0.00231083 0.00116892 2024-09-17T16:36:53.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.741+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:36:53.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.753+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:36:53.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.762+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:36:53.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.767+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:36:53.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.775+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:36:53.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.780+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:36:53.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.825+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:36:53.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.839+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:36:53.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.841+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:36:53.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.842+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:36:53.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:36:53.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.881+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:36:53.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.907+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:36:53.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.915+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:36:53.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.924+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:36:53.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.943+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:36:53.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.957+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:36:53.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:36:53.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.982+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:36:53.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.986+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:36:53.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.988+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:36:53.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:53.994+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:36:54.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.013+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:36:54.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.020+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:36:54.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.036+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:36:54.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.039+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:36:54.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.060+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:36:54.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.063+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:36:54.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.063+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:36:54.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.076+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:36:54.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.078+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:36:54.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:36:54.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.111+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:36:54.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.120+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:36:54.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.123+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:36:54.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.134+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:36:54.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.144+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:36:54.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.158+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:36:54.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.170+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:36:54.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.195+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:36:54.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.197+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:36:54.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.217+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:36:54.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.224+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:36:54.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.238+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:36:54.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.261+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:36:54.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.261+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:36:54.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.266+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:36:54.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.288+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:36:54.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.299+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:36:54.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.299+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:36:54.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.301+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:36:54.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.323+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:36:54.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.339+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:36:54.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.360+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:36:54.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.368+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:36:54.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.369+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:36:54.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.375+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:36:54.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.380+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:36:54.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.388+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:36:54.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.414+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:36:54.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.444+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:36:54.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:36:54.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.460+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:36:54.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.488+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:36:54.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.502+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:36:54.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.506+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:36:54.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.513+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:36:54.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.514+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:36:54.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.550+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:36:54.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.552+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:36:54.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.553+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:36:54.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.563+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:36:54.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.569+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:36:54.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.592+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:36:54.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.606+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:36:54.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.623+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:36:54.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.624+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:36:54.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.652+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:36:54.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.657+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:36:54.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.663+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:36:54.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.665+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:36:54.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.679+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:36:54.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.700+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:36:54.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.709+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:36:54.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.718+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:36:54.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.724+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:36:54.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.730+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:36:54.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 31 16 420831 420815 848.339 868.312 0.0010214 0.00116799 2024-09-17T16:36:54.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.747+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:36:54.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.751+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:36:54.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.774+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:36:54.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.782+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:36:54.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.784+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:36:54.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.788+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:36:54.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.799+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:36:54.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.824+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:36:54.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.836+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:36:54.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.836+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:36:54.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.859+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:36:54.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.862+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:36:54.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.872+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:36:54.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.882+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:36:54.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.887+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:36:54.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.900+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:36:54.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.900+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:36:54.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.909+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:36:54.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.910+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:36:54.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.921+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:36:54.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.947+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:36:54.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.953+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:36:54.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.953+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:36:54.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:54.965+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:36:55.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.003+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:36:55.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.011+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:36:55.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.024+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:36:55.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.032+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:36:55.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.032+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:36:55.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.038+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:36:55.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.044+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:36:55.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.053+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:36:55.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.155+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:36:55.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.174+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:36:55.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:36:55.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.183+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:36:55.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.188+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:36:55.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.211+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:36:55.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:36:55.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.232+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:36:55.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.243+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:36:55.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.275+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:36:55.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.281+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:36:55.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.303+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:36:55.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.307+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:36:55.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.336+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:36:55.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.359+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:36:55.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.365+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:36:55.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.380+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:36:55.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.384+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:36:55.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.387+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:36:55.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.409+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:36:55.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.435+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:36:55.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.449+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:36:55.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.456+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:36:55.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.474+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:36:55.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.491+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:36:55.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.494+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:36:55.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.496+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:36:55.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.505+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:36:55.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.506+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:36:55.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.548+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:36:55.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.555+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:36:55.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.569+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:36:55.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.582+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:36:55.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:36:55.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.590+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:36:55.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.607+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:36:55.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.610+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:36:55.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.628+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:36:55.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.640+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:36:55.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.642+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:36:55.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.648+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:36:55.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.672+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:36:55.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.680+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:36:55.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.685+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:36:55.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.688+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:36:55.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.709+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:36:55.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.713+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:36:55.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.718+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:36:55.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.728+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:36:55.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 32 16 433520 433504 846.609 793.062 0.000528823 0.00117029 2024-09-17T16:36:55.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.740+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:36:55.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.753+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:36:55.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.759+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:36:55.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.764+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:36:55.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.778+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:36:55.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.789+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:36:55.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.799+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:36:55.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.814+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:36:55.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.832+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:36:55.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.833+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:36:55.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.835+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:36:55.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.846+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:36:55.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.862+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:36:55.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.874+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:36:55.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.889+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:36:55.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.900+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:36:55.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.903+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:36:55.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.907+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:36:55.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.918+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:36:55.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:55.995+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:36:56.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.005+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:36:56.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.022+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:36:56.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.032+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:36:56.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.035+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:36:56.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.049+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:36:56.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.050+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:36:56.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.063+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:36:56.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.075+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:36:56.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.088+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:36:56.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:36:56.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.096+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:36:56.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.108+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:36:56.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.128+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:36:56.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.132+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:36:56.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.133+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:36:56.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.149+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:36:56.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.165+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:36:56.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.169+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:36:56.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.199+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:36:56.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:36:56.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.202+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:36:56.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.233+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:36:56.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.250+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:36:56.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.262+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:36:56.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.262+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:36:56.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.272+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:36:56.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.274+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:36:56.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.277+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:36:56.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.292+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:36:56.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.325+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:36:56.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.337+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:36:56.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.343+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:36:56.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.373+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:36:56.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.386+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:36:56.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.399+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:36:56.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.420+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:36:56.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.422+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:36:56.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.430+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:36:56.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.431+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:36:56.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.434+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:36:56.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.446+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:36:56.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.452+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:36:56.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.455+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:36:56.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.488+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:36:56.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.492+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:36:56.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.498+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:36:56.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.508+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:36:56.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.534+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:36:56.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.541+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:36:56.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:36:56.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.566+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:36:56.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.591+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:36:56.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.610+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:36:56.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.616+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:36:56.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.616+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:36:56.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.632+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:36:56.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.648+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:36:56.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.662+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:36:56.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.668+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:36:56.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.668+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:36:56.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.691+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:36:56.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.707+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:36:56.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.709+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:36:56.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.725+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:36:56.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.728+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:36:56.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.733+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:36:56.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.735+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:36:56.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 33 16 446524 446508 845.58 812.75 0.00076197 0.00117181 2024-09-17T16:36:56.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.747+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:36:56.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.751+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:36:56.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.775+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:36:56.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.793+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.805+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.825+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.833+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.836+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.837+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.865+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.876+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.876+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:36:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.891+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:36:56.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.906+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:36:56.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.907+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:36:56.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.928+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:36:56.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.933+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:36:56.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.938+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:36:56.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.939+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:36:56.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.949+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:36:56.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.986+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:36:56.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:56.990+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:36:57.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.004+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:36:57.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.037+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:36:57.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.053+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:36:57.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.059+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:36:57.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.065+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:36:57.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.067+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:36:57.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.072+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:36:57.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.078+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:36:57.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:36:57.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.094+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:36:57.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.116+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:36:57.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.153+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:36:57.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.160+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:36:57.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.167+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:36:57.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.201+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:36:57.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.211+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:36:57.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.217+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:36:57.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.249+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:36:57.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.253+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:36:57.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.254+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:36:57.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.261+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:36:57.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.268+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:36:57.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.300+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:36:57.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.311+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:36:57.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.319+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:36:57.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.329+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:36:57.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.333+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:36:57.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.352+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:36:57.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.369+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:36:57.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.372+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:36:57.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.373+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:36:57.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.405+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:36:57.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.413+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:36:57.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.421+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:36:57.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.422+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:36:57.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.423+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:36:57.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.439+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:36:57.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.441+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:36:57.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.453+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:36:57.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.475+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:36:57.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.490+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:36:57.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.491+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:36:57.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.499+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:36:57.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.511+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:36:57.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.534+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:36:57.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.538+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:36:57.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.539+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:36:57.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.547+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:36:57.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.556+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:36:57.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.569+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:36:57.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.582+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:36:57.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.588+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:36:57.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.606+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:36:57.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.609+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:36:57.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.611+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:36:57.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.615+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:36:57.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.621+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:36:57.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.688+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:36:57.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.696+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:36:57.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.707+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:36:57.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.731+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:36:57.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.734+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:36:57.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 34 15 459913 459898 845.322 836.875 0.000813112 0.00117221 2024-09-17T16:36:57.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.746+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:36:57.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.747+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:36:57.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.756+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:36:57.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.772+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:36:57.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.781+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:36:57.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.787+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:36:57.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.799+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:36:57.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.806+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:36:57.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.808+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:36:57.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.848+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:36:57.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.857+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:36:57.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.864+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:36:57.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.925+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:36:57.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.947+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:36:57.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.952+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:36:57.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:36:57.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.965+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:36:57.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:57.977+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:36:58.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.001+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:36:58.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.005+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:36:58.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.018+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:36:58.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.028+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:36:58.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.034+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:36:58.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.034+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:36:58.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.072+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:36:58.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.081+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:36:58.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.089+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:36:58.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.095+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:36:58.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.116+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:36:58.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.117+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:36:58.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.131+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:36:58.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.133+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:36:58.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.140+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:36:58.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.153+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:36:58.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.164+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:36:58.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:36:58.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.189+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:36:58.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.194+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:36:58.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.206+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:36:58.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.212+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:36:58.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.217+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:36:58.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.250+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:36:58.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.252+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:36:58.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.277+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:36:58.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.277+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:36:58.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.286+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:36:58.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.320+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:36:58.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.328+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:36:58.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.334+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:36:58.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.342+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:36:58.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.343+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:36:58.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.348+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:36:58.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.360+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:36:58.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.384+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:36:58.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.384+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:36:58.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.385+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:36:58.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.399+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:36:58.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.401+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:36:58.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.415+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:36:58.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.433+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:36:58.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.444+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:36:58.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.463+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:36:58.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.486+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:36:58.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.498+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:36:58.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.498+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:36:58.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.523+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:36:58.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.530+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:36:58.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.551+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:36:58.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.553+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:36:58.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.565+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:36:58.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.586+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:36:58.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.602+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:36:58.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.613+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:36:58.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.615+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:36:58.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.627+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:36:58.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.636+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:36:58.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.643+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:36:58.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.656+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:36:58.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.677+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:36:58.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.694+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:36:58.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.695+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:36:58.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.705+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:36:58.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.709+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:36:58.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.729+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:36:58.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 35 16 473772 473756 845.914 866.125 0.00170081 0.00117133 2024-09-17T16:36:58.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.754+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:36:58.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.763+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:36:58.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.770+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:36:58.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.771+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:36:58.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.771+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:36:58.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.789+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:36:58.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.794+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:36:58.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.800+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:36:58.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.802+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:36:58.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.837+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:36:58.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.856+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:36:58.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.865+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:36:58.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.885+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:36:58.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.896+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:36:58.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.901+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:36:58.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.926+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:36:58.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.932+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:36:58.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.933+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:36:58.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.944+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:36:58.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.946+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:36:58.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.981+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:36:58.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.981+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:36:58.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:58.992+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:36:59.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.003+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:36:59.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.004+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:36:59.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.014+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:36:59.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.021+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:36:59.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.043+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:36:59.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.043+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:36:59.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.056+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:36:59.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.065+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:36:59.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:36:59.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.098+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:36:59.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.106+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:36:59.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.107+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:36:59.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.117+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:36:59.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:36:59.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.157+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:36:59.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.159+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:36:59.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.178+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:36:59.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.189+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:36:59.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.194+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:36:59.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.197+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:36:59.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.219+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:36:59.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.223+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:36:59.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.230+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:36:59.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.235+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:36:59.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.239+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:36:59.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.248+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:36:59.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.271+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:36:59.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.279+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:36:59.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.308+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:36:59.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.321+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:36:59.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.346+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:36:59.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.352+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:36:59.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.361+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:36:59.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.363+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:36:59.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.364+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:36:59.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.382+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:36:59.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.402+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:36:59.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.420+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:36:59.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.421+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:36:59.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.439+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:36:59.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.447+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:36:59.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.448+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:36:59.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.449+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:36:59.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.473+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:36:59.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.475+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:36:59.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.483+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:36:59.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.505+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:36:59.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.510+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:36:59.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.555+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:36:59.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.562+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:36:59.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.587+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:36:59.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.603+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:36:59.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.609+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:36:59.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.618+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:36:59.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.637+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:36:59.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.655+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:36:59.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.668+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:36:59.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:36:59.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.680+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:36:59.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.695+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:36:59.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.722+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:36:59.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.723+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:36:59.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.723+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:36:59.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 36 16 487460 487444 846.178 855.5 0.000523612 0.00117094 2024-09-17T16:36:59.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.742+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:36:59.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.753+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:36:59.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.755+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:36:59.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.755+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:36:59.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.786+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:36:59.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.800+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:36:59.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.803+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:36:59.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.834+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:36:59.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.838+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:36:59.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.844+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:36:59.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.851+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:36:59.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.853+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:36:59.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:36:59.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.889+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:36:59.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.895+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:36:59.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.907+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:36:59.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.912+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:36:59.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.919+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:36:59.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.923+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:36:59.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.929+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:36:59.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.957+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:36:59.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.975+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:36:59.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.979+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:36:59.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:36:59.984+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:37:00.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.008+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:37:00.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.022+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:37:00.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.028+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:37:00.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.052+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:00.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.138+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:37:00.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.141+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:00.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:37:00.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.167+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:37:00.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.171+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:37:00.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.184+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:37:00.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.184+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:37:00.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.240+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:37:00.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.245+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:37:00.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.254+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:37:00.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.271+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:37:00.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.272+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:37:00.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.272+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:37:00.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:37:00.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.308+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:37:00.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.308+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:37:00.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.325+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:37:00.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.346+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:37:00.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.362+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:37:00.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.370+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:37:00.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.391+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:37:00.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.397+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:37:00.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.397+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:37:00.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.417+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:37:00.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.424+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:37:00.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.426+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:37:00.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.434+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:37:00.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:37:00.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.462+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:37:00.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.468+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:37:00.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.482+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:37:00.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.497+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:37:00.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.505+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:37:00.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.512+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:37:00.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.521+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:37:00.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.539+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:37:00.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.545+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:37:00.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.545+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:37:00.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.563+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:37:00.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.586+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:37:00.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.591+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:00.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.600+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:37:00.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.619+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:37:00.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.622+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:37:00.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.627+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:37:00.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.644+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:37:00.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.648+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:37:00.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:37:00.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.657+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:37:00.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.672+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:37:00.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.693+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:37:00.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.705+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:37:00.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.708+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:37:00.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.725+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:37:00.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.732+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:37:00.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 37 15 500079 500064 844.624 788.75 0.000627166 0.00117317 2024-09-17T16:37:00.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:37:00.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.751+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:37:00.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.754+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:37:00.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.756+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:37:00.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.766+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:37:00.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.775+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:37:00.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.777+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:37:00.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.810+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:37:00.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.811+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:37:00.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:00.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.853+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:37:00.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.853+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:37:00.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.855+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:37:00.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.884+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:37:00.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.892+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:37:00.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.899+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:37:00.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.914+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:37:00.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.915+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:37:00.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.938+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:37:00.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.977+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:37:00.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.984+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:01.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:00.998+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:37:01.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.005+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:37:01.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.007+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:01.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.033+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:37:01.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.040+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:37:01.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.043+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:37:01.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.051+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:37:01.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.057+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:37:01.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:37:01.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.108+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:37:01.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.108+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:37:01.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.130+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:37:01.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.181+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:37:01.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.194+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:37:01.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.197+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:37:01.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.231+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:01.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.234+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:37:01.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.252+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:01.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.259+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:37:01.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.282+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:37:01.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.293+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:37:01.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.303+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:37:01.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.317+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:37:01.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.327+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:37:01.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.330+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:37:01.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.351+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:37:01.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.367+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:37:01.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.396+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:37:01.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:37:01.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.422+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:37:01.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.425+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:37:01.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.432+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:37:01.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.445+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:37:01.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.454+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:37:01.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.459+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:37:01.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.474+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:37:01.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.476+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:37:01.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.495+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:37:01.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.503+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:37:01.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.511+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:37:01.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:37:01.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.541+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:37:01.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.555+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:37:01.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.561+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:37:01.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.578+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:37:01.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.585+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:37:01.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.588+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:37:01.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.589+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:37:01.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.622+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:37:01.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.622+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:37:01.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.639+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:37:01.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.648+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:37:01.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:37:01.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.668+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:37:01.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:37:01.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.697+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:01.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.699+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:37:01.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.714+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:37:01.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.719+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:37:01.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.730+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:37:01.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.734+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:37:01.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 38 16 513702 513686 844.8 851.375 0.000480746 0.0011728 2024-09-17T16:37:01.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.751+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:01.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.762+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:01.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.775+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:01.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.780+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:37:01.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.785+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:37:01.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.792+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:37:01.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.806+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:37:01.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.814+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:37:01.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.824+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:37:01.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.837+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:37:01.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.872+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:37:01.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.888+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:37:01.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.891+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:37:01.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.893+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:37:01.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:37:01.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.903+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:37:01.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.918+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:37:01.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.922+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:37:01.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.940+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:37:01.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.975+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:37:01.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.981+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:37:02.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:01.999+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:37:02.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.001+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:37:02.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:37:02.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.019+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:37:02.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.020+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:37:02.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.027+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:37:02.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.053+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:37:02.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.058+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:02.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.079+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:02.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.122+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:37:02.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.126+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:37:02.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.136+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:37:02.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.155+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:37:02.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.156+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:37:02.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.163+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:37:02.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.178+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:37:02.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.181+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:37:02.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.221+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:37:02.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.240+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:37:02.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.255+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:02.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.257+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:02.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.266+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:37:02.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.273+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:37:02.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.282+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:37:02.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.309+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:02.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.315+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:37:02.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.315+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:37:02.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.317+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:37:02.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.355+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:37:02.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.356+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:37:02.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.363+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:37:02.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.381+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:37:02.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.384+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:37:02.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.417+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:37:02.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.446+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:37:02.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.454+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:37:02.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.460+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:37:02.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.461+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:37:02.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.476+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:37:02.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.480+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:37:02.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.493+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:37:02.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.500+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:37:02.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.509+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:37:02.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.524+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:37:02.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.535+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:37:02.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.542+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:37:02.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.555+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:37:02.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.568+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:37:02.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.575+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:37:02.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.577+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:37:02.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.596+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:37:02.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.610+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:37:02.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.627+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:37:02.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.638+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:37:02.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.642+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:37:02.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.647+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:37:02.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.658+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:37:02.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.668+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:37:02.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.682+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:37:02.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.687+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:37:02.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.716+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:37:02.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.717+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:37:02.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.718+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:37:02.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 39 16 527359 527343 845.023 853.562 0.000598504 0.00117258 2024-09-17T16:37:02.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.749+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:37:02.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.752+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:37:02.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.754+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:37:02.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.768+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:37:02.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.775+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:37:02.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.819+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:37:02.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.820+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:37:02.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.843+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:37:02.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.856+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:37:02.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.859+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:37:02.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.860+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:37:02.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.875+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:37:02.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.886+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:37:02.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.915+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:37:02.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.919+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:37:02.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.955+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:37:02.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.981+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:02.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:02.984+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:37:03.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.018+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:37:03.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.019+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:37:03.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.021+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:37:03.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.042+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:37:03.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.046+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:37:03.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.053+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:37:03.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.068+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:37:03.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.098+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:37:03.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.112+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:37:03.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.118+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:37:03.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.124+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:37:03.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.162+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:37:03.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.165+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:37:03.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.176+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:37:03.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.178+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:03.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.198+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:37:03.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.205+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:37:03.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.215+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:37:03.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.224+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:03.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.243+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:37:03.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.243+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:37:03.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.248+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:37:03.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.251+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:37:03.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.276+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:37:03.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.282+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:37:03.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.286+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:03.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.308+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:37:03.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.311+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:37:03.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.322+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:37:03.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.333+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:37:03.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.343+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:37:03.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.364+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:37:03.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.387+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:37:03.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:37:03.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.407+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:37:03.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:37:03.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.446+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:37:03.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.457+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:37:03.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.476+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:37:03.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.484+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:37:03.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.494+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:37:03.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.497+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:37:03.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.501+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:37:03.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.528+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:37:03.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.532+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:37:03.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.540+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:37:03.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.545+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:37:03.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:37:03.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.587+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:37:03.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.587+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:37:03.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.615+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:37:03.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.617+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:37:03.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.627+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:37:03.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.628+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:37:03.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.648+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:37:03.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.653+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:37:03.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.677+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:37:03.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.678+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:37:03.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.701+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:37:03.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.703+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:03.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.715+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:37:03.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.715+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:37:03.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:37:03.739444+0000 min lat: 0.000231444 max lat: 0.110766 avg lat: 0.0011717 2024-09-17T16:37:03.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:37:03.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 40 16 541266 541250 845.626 869.188 0.000786516 0.0011717 2024-09-17T16:37:03.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.744+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:37:03.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.762+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:37:03.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.769+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:37:03.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.769+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:37:03.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.781+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:37:03.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.830+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:37:03.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.834+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:37:03.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.853+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:37:03.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.865+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:37:03.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.878+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:37:03.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.879+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:37:03.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.882+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:37:03.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.892+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:37:03.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.905+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:37:03.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:37:03.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.931+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:37:03.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.946+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:37:03.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.954+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:37:03.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.955+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:37:03.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.976+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:37:03.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.989+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:37:03.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:03.997+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:37:04.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.006+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:37:04.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.008+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:37:04.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:37:04.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.041+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:37:04.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.047+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:04.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.063+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:37:04.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.070+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:37:04.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.073+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:37:04.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.098+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:37:04.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:37:04.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.118+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:37:04.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.127+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:37:04.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.134+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:37:04.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.146+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:37:04.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.148+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:37:04.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.158+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:37:04.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.194+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:04.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.196+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:04.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.222+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:37:04.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.222+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:37:04.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.238+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:37:04.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.249+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:37:04.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.252+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:37:04.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.271+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:37:04.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.276+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:37:04.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.314+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:37:04.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.318+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:37:04.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.328+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:37:04.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.335+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:37:04.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.338+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:04.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.341+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:37:04.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.354+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:37:04.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.355+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:04.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.355+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:37:04.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:37:04.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:37:04.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.404+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:37:04.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.417+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:37:04.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.441+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:04.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.446+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:37:04.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.447+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:37:04.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.459+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:37:04.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.487+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:37:04.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.498+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:37:04.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.520+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:37:04.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.528+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:37:04.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.530+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:37:04.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:37:04.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.552+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:37:04.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.578+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:37:04.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.579+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:37:04.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.588+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:37:04.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.592+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:37:04.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.597+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:37:04.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.637+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:37:04.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.654+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:37:04.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.664+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:37:04.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:37:04.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.672+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:37:04.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.681+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:37:04.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.691+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:37:04.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.708+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:37:04.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.719+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:37:04.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.724+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:37:04.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.733+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:37:04.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 41 16 554861 554845 845.723 849.688 0.00073552 0.00117157 2024-09-17T16:37:04.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.748+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:37:04.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.749+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:37:04.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.790+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:37:04.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.806+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:37:04.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:37:04.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.822+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:37:04.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.828+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:37:04.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.829+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:37:04.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.834+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:04.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:37:04.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.863+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:37:04.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.881+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:37:04.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.881+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:37:04.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.894+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:37:04.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.927+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:37:04.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.930+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:37:04.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.946+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:04.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.952+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:37:04.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.961+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:37:04.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.966+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:37:04.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.982+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:37:04.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:04.983+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:37:05.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.005+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:05.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.012+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:37:05.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.017+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:37:05.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:37:05.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.043+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:37:05.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.055+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:37:05.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.060+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:37:05.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.066+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:37:05.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.079+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:37:05.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.100+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:37:05.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.103+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:37:05.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.116+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:05.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.120+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:37:05.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:37:05.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.177+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:37:05.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.194+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:37:05.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:37:05.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.210+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:37:05.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.218+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:37:05.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:37:05.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.234+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:37:05.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.259+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:37:05.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.265+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:37:05.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.275+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:37:05.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.291+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:37:05.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.294+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:37:05.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.303+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:37:05.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.324+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:37:05.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.328+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:37:05.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.337+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:37:05.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.341+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:37:05.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.344+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:05.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.357+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:37:05.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.359+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:05.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.367+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:37:05.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.380+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:37:05.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.387+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:37:05.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.419+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:05.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.420+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:37:05.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.429+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:05.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.439+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:37:05.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.447+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:37:05.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.476+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:37:05.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.486+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:37:05.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.497+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:05.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.508+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:37:05.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.526+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:37:05.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.542+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:37:05.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.547+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:37:05.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.552+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:37:05.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.559+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:37:05.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.565+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:37:05.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.581+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:37:05.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.585+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:37:05.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.587+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:05.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.589+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:37:05.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.636+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:37:05.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:37:05.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.672+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:37:05.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.684+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:37:05.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.692+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:37:05.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.692+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:37:05.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.726+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:37:05.740 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 42 16 568251 568235 845.511 836.875 0.000752299 0.00117194 2024-09-17T16:37:05.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.743+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:37:05.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.752+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:37:05.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.753+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:37:05.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.755+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:37:05.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.783+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:37:05.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.796+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:37:05.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.802+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:37:05.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.829+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:37:05.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.838+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:37:05.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.844+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:37:05.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.846+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:37:05.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.852+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:37:05.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.873+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:37:05.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.895+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:37:05.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.901+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:37:05.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.911+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:37:05.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.920+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:37:05.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.923+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:37:05.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.954+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:37:05.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:05.996+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:37:06.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.023+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:37:06.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.025+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:37:06.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.036+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:37:06.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.039+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:37:06.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.087+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:37:06.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.096+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:06.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.114+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:37:06.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.124+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:37:06.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.124+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:37:06.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.128+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:37:06.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.147+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:37:06.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.152+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:37:06.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.156+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:37:06.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.167+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:37:06.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.170+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:37:06.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.178+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:37:06.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.200+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:37:06.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.221+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:37:06.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.239+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:37:06.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.248+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:37:06.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.259+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:37:06.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.261+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:37:06.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.268+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:37:06.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.271+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:06.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.280+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:37:06.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.286+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:37:06.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.317+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:37:06.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.348+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:37:06.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.373+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:37:06.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.383+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:37:06.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.386+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:37:06.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.395+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:37:06.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.409+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:37:06.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.422+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:37:06.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.433+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:37:06.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.439+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:37:06.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.448+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:06.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.449+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:37:06.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.457+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:37:06.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.460+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:37:06.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.468+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:37:06.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.474+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:37:06.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.489+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:37:06.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.502+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:37:06.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.518+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:37:06.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.553+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:37:06.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.566+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:06.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.568+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:37:06.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.595+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:37:06.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.598+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:37:06.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:06.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.600+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:37:06.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.616+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:37:06.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.617+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:37:06.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.632+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:37:06.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.636+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:37:06.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.657+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:37:06.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.662+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:37:06.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.673+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:37:06.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.704+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:06.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.704+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:37:06.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.705+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:37:06.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.713+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:37:06.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.717+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:37:06.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.731+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:37:06.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 43 16 581216 581200 844.69 810.312 0.000997818 0.00117295 2024-09-17T16:37:06.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.746+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:06.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.759+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:37:06.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.762+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:37:06.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.766+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:37:06.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.772+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:37:06.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.796+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:37:06.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:37:06.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.822+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:37:06.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.833+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:37:06.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.834+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:37:06.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.839+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:37:06.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.863+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:37:06.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.894+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:37:06.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.913+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:37:06.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:37:06.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.932+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:37:06.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.939+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:37:06.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.959+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:37:06.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.967+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:37:06.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.977+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:37:06.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.984+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:37:06.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:06.994+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:37:07.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.017+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:37:07.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.017+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:37:07.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.018+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:37:07.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.042+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:37:07.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.049+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:37:07.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.066+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:37:07.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.082+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:37:07.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.102+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:37:07.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.121+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:37:07.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.128+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:37:07.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.132+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:37:07.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.140+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:37:07.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:37:07.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.165+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:37:07.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.166+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:37:07.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.167+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:37:07.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.192+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:37:07.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.202+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:37:07.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.208+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:37:07.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.211+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:37:07.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.216+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:37:07.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.240+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:37:07.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.264+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:37:07.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.268+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:37:07.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.271+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:37:07.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.278+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:37:07.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.282+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:07.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.307+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:37:07.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.309+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:37:07.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.322+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:37:07.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.330+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:37:07.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.331+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:37:07.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:07.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.359+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:37:07.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:37:07.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.386+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:37:07.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.392+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:37:07.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.401+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:37:07.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.401+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:37:07.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.426+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:37:07.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.430+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:37:07.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.430+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:37:07.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.451+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:37:07.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.482+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:37:07.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.503+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:37:07.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.524+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:37:07.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.528+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:37:07.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.535+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:37:07.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.539+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:37:07.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.540+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:37:07.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.547+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:37:07.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.600+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:37:07.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.603+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:37:07.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.621+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:37:07.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:37:07.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.640+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:37:07.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.652+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:37:07.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.657+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:37:07.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.673+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:37:07.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.675+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:37:07.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.677+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:37:07.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.687+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:37:07.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.704+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:37:07.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.707+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:37:07.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.728+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:37:07.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.734+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:37:07.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 44 15 594959 594944 845.014 859 0.000946675 0.00117259 2024-09-17T16:37:07.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.751+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:37:07.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.760+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:37:07.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.778+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:37:07.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.798+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:37:07.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.802+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:37:07.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.808+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:37:07.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.838+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:37:07.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.840+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:37:07.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.846+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:37:07.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.847+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:37:07.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.881+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:37:07.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.890+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:37:07.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.911+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:37:07.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.921+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:37:07.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.921+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:37:07.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:37:07.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.953+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:37:07.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.957+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:37:07.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.957+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:37:07.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.968+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:37:07.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:07.996+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:37:08.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.004+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:37:08.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.005+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:37:08.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.013+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:37:08.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.029+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:37:08.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.031+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:37:08.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.050+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:37:08.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.061+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:37:08.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.066+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:37:08.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.075+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:08.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.080+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:37:08.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.081+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:37:08.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:37:08.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.118+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:37:08.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.134+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:37:08.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.148+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:37:08.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.151+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:37:08.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.162+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:37:08.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.182+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:37:08.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.195+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:37:08.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.202+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:37:08.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.218+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:37:08.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.235+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:37:08.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.243+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:37:08.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.244+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:37:08.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.245+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:37:08.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.248+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:08.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:37:08.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.288+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:37:08.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.294+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:37:08.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.298+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:37:08.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.312+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:37:08.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.319+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:37:08.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.324+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:37:08.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.338+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:37:08.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.344+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:08.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.389+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:37:08.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.392+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:37:08.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:37:08.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.412+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:37:08.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:37:08.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.425+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:37:08.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:37:08.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.461+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:37:08.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.469+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:37:08.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.496+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:37:08.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.502+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:37:08.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.512+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:37:08.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.529+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:37:08.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.530+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:37:08.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.539+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:37:08.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.562+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:37:08.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.568+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:37:08.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.575+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:37:08.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.606+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:37:08.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.614+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:37:08.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.620+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:37:08.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.622+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:37:08.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.633+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:37:08.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.656+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:37:08.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.674+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:37:08.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.691+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:37:08.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.692+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:37:08.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.718+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:37:08.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:37:08.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 45 16 609190 609174 845.998 889.375 0.00231587 0.00117126 2024-09-17T16:37:08.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.746+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:37:08.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.755+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:37:08.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.767+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:37:08.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.776+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:37:08.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.780+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:37:08.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.788+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:37:08.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.795+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:37:08.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.803+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:37:08.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.811+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:08.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.820+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:37:08.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.841+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:08.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.852+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:37:08.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.852+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:37:08.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.879+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:37:08.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.926+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:37:08.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.926+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:37:08.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.947+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:37:08.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.958+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:37:08.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.965+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:37:08.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.974+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:37:08.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.977+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:37:08.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:08.993+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:37:09.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.016+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:37:09.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.023+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:37:09.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.031+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:37:09.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.033+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:37:09.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.044+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:37:09.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.063+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:37:09.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.074+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:37:09.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.075+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:37:09.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.076+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:37:09.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.081+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:37:09.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.115+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:37:09.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.120+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:09.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.130+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:37:09.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.131+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:37:09.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.157+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:37:09.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:37:09.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:37:09.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.192+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:37:09.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.205+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:37:09.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:37:09.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.219+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:37:09.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.226+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:37:09.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.231+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:37:09.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.261+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:37:09.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.278+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:37:09.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.284+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:37:09.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.293+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:37:09.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.304+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:09.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.313+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:37:09.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.320+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:37:09.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.334+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:37:09.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.355+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:37:09.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.382+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:37:09.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.388+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:37:09.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.395+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:37:09.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.418+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:37:09.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.418+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:37:09.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.433+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:37:09.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.436+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:37:09.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.451+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:37:09.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.456+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:37:09.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.472+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:37:09.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.475+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:37:09.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.484+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:37:09.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.501+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:09.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.506+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:37:09.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.540+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:37:09.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.544+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:37:09.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.556+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:37:09.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.573+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:09.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.581+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:37:09.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.582+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:37:09.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.599+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:37:09.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.613+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:09.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.632+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:37:09.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.638+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:37:09.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.639+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:37:09.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.671+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:09.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.674+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:37:09.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.692+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:37:09.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.696+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:09.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.709+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:37:09.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.712+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:37:09.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.724+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:37:09.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 46 16 622633 622617 845.87 840.188 0.000856926 0.00117142 2024-09-17T16:37:09.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:37:09.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.769+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:37:09.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.770+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:37:09.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.771+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:37:09.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.780+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:09.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.814+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:37:09.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.825+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:37:09.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.825+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:37:09.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.849+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:37:09.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.855+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:37:09.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.879+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:37:09.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.885+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:37:09.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:37:09.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.886+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:37:09.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.898+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:37:09.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.901+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:37:09.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.943+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:37:09.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.947+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:37:09.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.949+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:37:09.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.964+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:37:09.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.985+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:37:09.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.991+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:37:09.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:09.992+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:10.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.005+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:37:10.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.011+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:37:10.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.022+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:37:10.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.028+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:37:10.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.056+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:37:10.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.063+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:37:10.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.084+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:37:10.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.094+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:37:10.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.098+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:37:10.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.104+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:37:10.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.109+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:37:10.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.111+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:37:10.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.123+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:37:10.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.132+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:37:10.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.163+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:37:10.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.165+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:37:10.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.170+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:37:10.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.177+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:37:10.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.189+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:37:10.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.225+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:37:10.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.225+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:37:10.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.235+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:37:10.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.248+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:37:10.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.252+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:37:10.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.284+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:37:10.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.285+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:37:10.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.290+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:37:10.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.299+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:37:10.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:37:10.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.321+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:37:10.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.332+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:37:10.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.338+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:37:10.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.350+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:37:10.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.354+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:37:10.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.372+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:37:10.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.375+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:37:10.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.389+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:37:10.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.434+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:37:10.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.441+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:37:10.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.450+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:37:10.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.455+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:37:10.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.459+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:37:10.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.461+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:37:10.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.471+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:37:10.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.490+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:37:10.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.504+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:37:10.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.508+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:37:10.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.516+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:37:10.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.516+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:37:10.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:37:10.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.559+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:37:10.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.578+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:37:10.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.585+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:37:10.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.597+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:37:10.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.602+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:37:10.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.629+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:37:10.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.633+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:37:10.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:37:10.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.689+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:37:10.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.690+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:37:10.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.696+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:37:10.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.710+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:37:10.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.720+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:37:10.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 47 16 636444 636428 846.237 863.188 0.000633725 0.00117089 2024-09-17T16:37:10.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:37:10.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.747+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:37:10.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.749+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:37:10.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.761+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:37:10.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.770+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:37:10.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.771+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:37:10.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.810+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:37:10.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.813+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:37:10.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.815+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:37:10.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.821+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:37:10.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.846+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:37:10.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.858+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:37:10.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.872+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:37:10.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.887+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:37:10.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.889+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:37:10.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:37:10.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.919+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:37:10.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.920+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:10.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.936+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:37:10.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.937+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:37:10.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.943+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:37:10.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:37:10.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:10.969+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:37:11.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.036+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:37:11.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.050+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:37:11.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.053+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:37:11.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.057+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:37:11.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.058+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:37:11.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.074+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:37:11.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.087+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:11.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.100+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:37:11.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.123+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:37:11.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.124+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:11.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.145+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:37:11.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.156+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:37:11.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.180+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:37:11.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.184+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:37:11.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.210+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:11.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.226+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:37:11.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.239+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:37:11.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.254+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:37:11.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.256+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:37:11.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.258+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:37:11.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:37:11.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.278+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:37:11.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.297+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:37:11.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.311+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:37:11.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.316+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:37:11.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:37:11.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.335+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:37:11.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.356+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:37:11.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.375+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:37:11.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.379+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:37:11.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.389+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:37:11.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.404+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:37:11.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.414+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:37:11.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.423+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:37:11.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.430+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:37:11.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:37:11.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.453+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:11.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.462+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:37:11.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.472+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:37:11.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.473+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:37:11.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.489+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:37:11.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.492+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:37:11.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.498+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:37:11.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.501+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:11.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.559+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:37:11.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.559+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:37:11.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.573+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:37:11.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.583+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:37:11.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.591+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:37:11.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.600+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:37:11.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.609+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:37:11.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.620+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:37:11.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.628+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:37:11.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.650+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:37:11.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.657+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:37:11.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.670+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:37:11.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.696+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:37:11.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.696+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:37:11.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.701+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:37:11.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.702+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:37:11.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.719+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:37:11.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.737+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:37:11.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 48 16 649503 649487 845.61 816.188 0.00066051 0.0011717 2024-09-17T16:37:11.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.741+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:37:11.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.753+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:37:11.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.757+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:37:11.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.775+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:37:11.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.799+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:37:11.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.807+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:11.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.807+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:37:11.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.814+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:37:11.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.818+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:37:11.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.824+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:37:11.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.833+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:37:11.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.847+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:11.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.848+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:37:11.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.876+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:37:11.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.896+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:37:11.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.927+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:37:11.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.952+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:37:11.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.954+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:37:11.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.969+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:37:11.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:11.974+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:37:12.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.010+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:37:12.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.011+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:37:12.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.020+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:37:12.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.052+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:37:12.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.052+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:37:12.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.061+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:37:12.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.069+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:37:12.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.079+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:37:12.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.090+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:37:12.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.097+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:37:12.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.102+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:37:12.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.122+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:37:12.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.125+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:37:12.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.163+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:37:12.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.188+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:37:12.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.210+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:37:12.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.217+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:37:12.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.237+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:37:12.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.243+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:37:12.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.245+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:37:12.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.247+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:37:12.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.266+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:37:12.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.283+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:37:12.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.306+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:37:12.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.309+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:37:12.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.319+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:37:12.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.319+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:37:12.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.321+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:37:12.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.329+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:37:12.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.367+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:12.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:37:12.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.390+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:37:12.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:37:12.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.413+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:37:12.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.420+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:37:12.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:37:12.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.429+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:37:12.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.446+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:37:12.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.465+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:37:12.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.469+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:37:12.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.482+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:37:12.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.483+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:37:12.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.484+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:37:12.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.490+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:37:12.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.508+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:37:12.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:37:12.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.529+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:37:12.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.531+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:37:12.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.533+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:37:12.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:37:12.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.581+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:37:12.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.586+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:37:12.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.588+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:37:12.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.599+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:37:12.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.602+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:37:12.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.619+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:37:12.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.635+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:37:12.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.638+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:37:12.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.650+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:37:12.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.658+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:37:12.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.681+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:37:12.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.691+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:37:12.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.717+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:37:12.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.723+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:37:12.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.727+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:37:12.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.732+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:37:12.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 49 16 663118 663102 845.717 850.938 0.000527123 0.00117159 2024-09-17T16:37:12.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.744+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:37:12.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.745+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:37:12.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.780+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:37:12.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.812+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:37:12.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.817+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:37:12.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.842+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:37:12.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.842+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:37:12.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.853+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:37:12.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.880+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:37:12.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.894+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:37:12.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.904+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:37:12.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.921+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:37:12.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.923+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:37:12.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.923+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:37:12.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.954+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:37:12.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:37:12.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.974+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:37:12.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.983+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:37:12.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:12.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:37:13.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.017+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:37:13.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.020+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:37:13.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.022+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:37:13.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.025+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:37:13.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.050+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:37:13.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.056+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:37:13.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.070+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:37:13.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.086+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:37:13.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.092+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:37:13.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.094+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:37:13.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.111+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:37:13.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.114+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:13.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.120+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:37:13.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.148+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:37:13.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:37:13.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:37:13.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.167+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:37:13.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.173+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:37:13.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.177+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:37:13.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.182+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:37:13.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.204+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:37:13.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.218+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:37:13.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.235+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:37:13.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.253+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:37:13.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.271+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:13.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.274+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:37:13.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.282+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:13.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.295+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:37:13.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.312+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:37:13.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:37:13.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.325+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:37:13.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.328+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:13.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.334+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:37:13.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.345+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:37:13.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.350+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:37:13.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.373+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:37:13.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.375+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:37:13.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.379+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:13.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.401+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:37:13.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.432+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:37:13.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.433+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:37:13.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:37:13.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.466+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:37:13.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:37:13.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.482+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:37:13.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.485+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:13.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.495+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:37:13.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.521+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:37:13.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.528+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:37:13.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.538+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:37:13.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.564+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:37:13.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.565+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:37:13.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.565+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:37:13.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:13.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.586+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:37:13.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.632+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:37:13.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.640+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:37:13.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.643+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:37:13.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.657+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:37:13.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.682+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:37:13.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.698+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:37:13.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.728+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:37:13.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 50 15 677183 677168 846.384 879.125 0.00063845 0.00117071 2024-09-17T16:37:13.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.745+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:37:13.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.757+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:37:13.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.763+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:37:13.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.764+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:37:13.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.794+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:37:13.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.802+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:37:13.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.817+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:37:13.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.818+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:37:13.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.830+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:37:13.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.831+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:37:13.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.850+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:37:13.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.857+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:37:13.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.861+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:37:13.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.881+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:37:13.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.890+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:37:13.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.896+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:37:13.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.915+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:37:13.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.929+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:37:13.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.943+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:37:13.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.952+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:37:13.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.976+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:37:13.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:13.983+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:37:14.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.000+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:37:14.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.004+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:37:14.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.016+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:37:14.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.016+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:37:14.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.025+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:37:14.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.050+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:37:14.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.062+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:37:14.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.066+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:37:14.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.109+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:37:14.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:37:14.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.135+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:37:14.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.137+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:37:14.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.161+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:37:14.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.165+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:37:14.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:14.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.194+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:37:14.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.200+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:37:14.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.228+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:37:14.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.232+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:37:14.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.235+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:37:14.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.244+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:37:14.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.249+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:37:14.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.251+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:37:14.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.267+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:37:14.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.280+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:37:14.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.311+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:37:14.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.327+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:37:14.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.327+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:37:14.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.344+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:37:14.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.345+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:37:14.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.360+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:37:14.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.366+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:37:14.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.384+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:37:14.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.390+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:37:14.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.393+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:37:14.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.400+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:37:14.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.420+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:37:14.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.426+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:37:14.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.429+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:37:14.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.431+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:37:14.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.442+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:37:14.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.453+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:37:14.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.456+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:37:14.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.461+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:37:14.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.484+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:37:14.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.493+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:37:14.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.499+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:37:14.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.505+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:37:14.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.513+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:37:14.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.533+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:37:14.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.546+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:37:14.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.573+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:37:14.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.586+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:37:14.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.602+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:37:14.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.612+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:37:14.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.614+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:37:14.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.634+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:37:14.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.638+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:37:14.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.648+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:37:14.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.653+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:37:14.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.677+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:37:14.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.681+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:37:14.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.684+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:37:14.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.687+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:37:14.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.690+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:37:14.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.713+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:37:14.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.722+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:37:14.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.725+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:37:14.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 51 16 691150 691134 846.902 872.875 0.0012249 0.00116994 2024-09-17T16:37:14.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.771+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:37:14.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.779+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:37:14.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.797+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:14.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.800+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:37:14.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.801+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:37:14.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.801+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:14.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.815+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:37:14.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.821+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:37:14.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.848+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:37:14.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.865+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:37:14.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.896+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:37:14.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.901+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:37:14.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.910+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:37:14.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.921+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:37:14.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.924+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:37:14.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.937+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:37:14.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.950+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:37:14.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.956+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:37:14.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.969+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:37:14.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.987+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:37:14.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.991+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:37:14.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:14.994+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:37:15.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.004+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:37:15.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.011+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:37:15.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.051+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:37:15.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.055+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:37:15.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.056+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:37:15.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.072+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:37:15.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:37:15.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.082+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:37:15.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.093+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:37:15.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.122+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:37:15.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.144+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:37:15.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.164+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:37:15.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.165+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:37:15.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.167+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:37:15.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:37:15.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.219+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:37:15.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.254+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:37:15.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.265+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:37:15.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.275+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:37:15.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.286+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:37:15.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.302+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:37:15.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.309+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:37:15.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.312+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:37:15.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.322+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:37:15.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.346+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:37:15.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.364+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:37:15.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.385+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:37:15.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:37:15.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.390+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:37:15.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.395+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:37:15.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.397+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:37:15.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.432+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:15.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.456+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:37:15.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.457+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:37:15.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.474+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:37:15.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.474+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:37:15.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:37:15.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.505+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:37:15.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.506+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:37:15.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.518+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:37:15.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.523+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:37:15.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.546+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:37:15.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.561+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:37:15.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.570+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:37:15.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:37:15.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.579+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:37:15.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.594+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:37:15.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.599+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:37:15.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.603+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:15.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.637+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:37:15.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.639+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:37:15.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.660+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:37:15.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.667+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:37:15.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.673+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:15.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.689+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:37:15.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.702+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:37:15.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.715+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:37:15.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.724+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:37:15.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.726+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:37:15.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 52 16 704658 704642 846.85 844.25 0.000664252 0.00117003 2024-09-17T16:37:15.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.742+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:37:15.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.759+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:37:15.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.763+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:37:15.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.766+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:37:15.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.794+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:37:15.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.795+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:37:15.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.801+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:37:15.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.801+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:37:15.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.821+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:37:15.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.835+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:37:15.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.841+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:37:15.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.850+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:37:15.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.855+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:37:15.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.864+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:37:15.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:37:15.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.907+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:37:15.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.908+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:37:15.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.935+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:37:15.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.953+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:37:15.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.955+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:37:15.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.972+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:37:15.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.982+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:37:15.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.990+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:37:15.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:15.996+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:37:16.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.004+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:37:16.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.022+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:37:16.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.025+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:37:16.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.036+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:37:16.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.049+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:37:16.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.062+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:37:16.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.067+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:37:16.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.069+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:37:16.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.096+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:37:16.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.115+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:37:16.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.130+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:16.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.140+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:16.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.142+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:37:16.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.161+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:37:16.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.184+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:37:16.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.194+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:37:16.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.213+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:37:16.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.215+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:37:16.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.228+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:37:16.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.230+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:37:16.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.231+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:37:16.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.244+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:37:16.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.263+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:37:16.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.269+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:37:16.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.290+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:37:16.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.294+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:37:16.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.302+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:37:16.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.319+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:37:16.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.333+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:37:16.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.349+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:37:16.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:37:16.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.364+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:37:16.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.375+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:37:16.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.390+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:37:16.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.393+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:37:16.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.394+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:37:16.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.398+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:37:16.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.407+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:37:16.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.418+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:37:16.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.420+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:37:16.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.433+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:37:16.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.452+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:37:16.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.474+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:37:16.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.474+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:37:16.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.479+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:16.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.491+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:37:16.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.499+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:37:16.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.529+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:16.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.532+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:37:16.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.540+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:37:16.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.542+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:37:16.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.559+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:37:16.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.574+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:37:16.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.607+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:37:16.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.618+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:37:16.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.624+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:37:16.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:37:16.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.647+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:37:16.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.657+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:37:16.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.658+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:37:16.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.664+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:37:16.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.670+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:37:16.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.673+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:37:16.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.699+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:37:16.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.727+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:37:16.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.739+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:37:16.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 53 16 718330 718314 846.993 854.5 0.000683969 0.00116986 2024-09-17T16:37:16.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.751+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:37:16.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.763+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:37:16.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.782+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:37:16.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.787+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:37:16.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:37:16.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.819+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:37:16.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.824+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:37:16.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.830+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:37:16.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.851+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:37:16.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.864+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:37:16.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.870+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:37:16.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.905+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:37:16.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.921+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:37:16.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.927+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:37:16.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.945+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:16.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:37:16.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.959+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:37:16.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.964+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:37:16.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.970+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:37:16.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.970+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:37:16.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:16.994+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:37:17.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.000+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:37:17.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.015+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:37:17.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.049+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:37:17.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.059+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:37:17.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.078+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:37:17.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.079+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:37:17.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.092+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:37:17.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.098+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:37:17.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.122+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:37:17.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.125+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:37:17.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.150+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:37:17.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.172+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:37:17.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.173+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:37:17.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.174+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:37:17.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.187+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:37:17.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.219+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:37:17.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.220+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:37:17.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.241+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:37:17.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.242+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:37:17.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.244+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:37:17.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.265+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:37:17.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.266+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:37:17.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.271+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:37:17.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.304+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:37:17.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.313+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:37:17.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.327+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:37:17.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.327+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:37:17.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.345+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:37:17.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.370+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:37:17.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.384+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:37:17.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.388+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:37:17.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.403+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:37:17.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.413+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:37:17.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:37:17.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.421+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:37:17.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.438+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:37:17.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.458+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:37:17.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.487+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:37:17.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.518+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:17.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.521+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:37:17.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.526+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:37:17.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.526+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:37:17.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.547+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:37:17.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.553+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:37:17.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.567+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:37:17.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.579+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:37:17.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.609+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:37:17.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.610+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:37:17.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.620+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:37:17.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.632+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:37:17.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.647+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:37:17.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.650+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:37:17.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.681+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:37:17.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.684+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:37:17.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.715+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:37:17.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.724+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:37:17.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.733+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:37:17.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 54 15 732178 732163 847.335 865.562 0.000788536 0.00116939 2024-09-17T16:37:17.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.740+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:37:17.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.745+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:37:17.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.766+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:37:17.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.778+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:37:17.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.794+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:37:17.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.801+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:37:17.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:37:17.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.823+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:37:17.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.834+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:37:17.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.847+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:37:17.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.859+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:37:17.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.877+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:37:17.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.877+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:37:17.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.888+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:37:17.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.898+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:37:17.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.901+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:37:17.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.908+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:37:17.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.924+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:37:17.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.925+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:37:17.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.956+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:37:17.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.967+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:37:17.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.984+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:37:17.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:17.987+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:37:18.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.031+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:37:18.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.038+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:37:18.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.055+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:37:18.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.060+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:37:18.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.072+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:18.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.083+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:37:18.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:37:18.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:18.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.128+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:37:18.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.135+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:37:18.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:37:18.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.153+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:37:18.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.158+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:37:18.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.173+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:37:18.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.173+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:37:18.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.181+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:37:18.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.185+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:37:18.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.190+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:37:18.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.212+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:37:18.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.231+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:37:18.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.236+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:37:18.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.238+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:37:18.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.260+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:37:18.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.282+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:37:18.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.285+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:18.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.289+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:37:18.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.299+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:37:18.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.313+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:37:18.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.320+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:37:18.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.346+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:37:18.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.382+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:37:18.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.383+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:37:18.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.385+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:37:18.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.468+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:37:18.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.476+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:37:18.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.480+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:37:18.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.487+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:37:18.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.488+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:37:18.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.511+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:37:18.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.520+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:37:18.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.524+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:37:18.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.556+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:37:18.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.556+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:37:18.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.582+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:37:18.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.590+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:37:18.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.600+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:37:18.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.602+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:37:18.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.635+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:37:18.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.656+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:37:18.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.677+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:37:18.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.685+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:37:18.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.697+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:37:18.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.703+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:37:18.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.712+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:37:18.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.718+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:37:18.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.729+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:37:18.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.730+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:37:18.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 55 15 746525 746510 848.231 896.688 0.000707893 0.00116814 2024-09-17T16:37:18.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.768+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:37:18.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.770+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:37:18.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.784+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:18.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.807+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:37:18.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.807+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:37:18.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.810+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:37:18.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.831+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:37:18.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.832+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:37:18.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.835+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:37:18.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.840+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:37:18.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.859+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:37:18.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.868+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:37:18.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.888+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:37:18.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.900+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:37:18.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.901+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:37:18.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.937+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:37:18.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.943+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:37:18.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.945+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:37:18.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.946+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:37:18.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.973+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:37:18.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.978+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:37:18.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:18.993+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:37:19.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.009+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:37:19.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.013+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:37:19.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.019+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:37:19.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.019+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:37:19.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.053+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:37:19.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.053+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:37:19.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.055+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:37:19.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.072+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:37:19.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.088+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:37:19.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.105+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:19.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.113+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:37:19.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.147+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:37:19.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:37:19.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.155+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:37:19.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.165+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:37:19.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.168+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:37:19.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.196+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:37:19.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.198+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:19.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:19.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.220+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:37:19.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.230+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:37:19.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.241+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:37:19.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.251+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:37:19.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.259+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:37:19.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:37:19.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.266+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:37:19.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.294+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:37:19.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.304+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:37:19.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.309+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:37:19.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.320+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:37:19.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.324+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:37:19.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.334+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:37:19.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.348+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:37:19.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.387+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:37:19.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.390+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:37:19.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.398+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:37:19.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.402+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:37:19.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.416+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:37:19.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.430+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:37:19.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.453+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:37:19.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.458+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:37:19.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.479+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:37:19.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.492+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:37:19.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.507+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:37:19.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.512+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:37:19.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.519+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:37:19.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.523+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:37:19.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.529+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:37:19.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.532+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:37:19.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.540+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:37:19.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.549+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:37:19.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.561+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:37:19.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.595+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:37:19.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.602+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:37:19.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.614+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:37:19.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.622+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:37:19.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.653+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:37:19.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.653+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:37:19.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.678+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:37:19.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.687+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:37:19.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.693+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:37:19.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.699+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:37:19.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.717+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:37:19.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.727+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:37:19.741 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 56 16 760217 760201 848.363 855.688 0.00104458 0.00116797 2024-09-17T16:37:19.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.746+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:37:19.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.756+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:37:19.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.757+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:37:19.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.782+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:37:19.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.782+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:37:19.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.809+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:37:19.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.820+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:37:19.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.831+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:37:19.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.839+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:37:19.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.840+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:37:19.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.848+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:37:19.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.855+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:37:19.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.857+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:37:19.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.878+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:37:19.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.894+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:37:19.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.911+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:37:19.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.934+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:37:19.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:37:19.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:37:19.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.971+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:37:19.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.974+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:37:19.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:19.986+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:37:20.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.003+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:37:20.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.011+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:37:20.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.046+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:37:20.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.052+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:37:20.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.065+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:37:20.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.066+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:37:20.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.093+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:37:20.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.096+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:37:20.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.103+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:37:20.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.116+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:37:20.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.129+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:37:20.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.151+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:37:20.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.155+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:37:20.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.188+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:37:20.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.191+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:37:20.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.215+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:20.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.217+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:37:20.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.229+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:37:20.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.237+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:37:20.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.281+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:37:20.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.287+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:37:20.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.298+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:37:20.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.306+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:20.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.316+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:37:20.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.321+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:37:20.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.324+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:37:20.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.332+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:37:20.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.345+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:37:20.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.346+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:37:20.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.355+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:37:20.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.356+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:37:20.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.374+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:37:20.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.380+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:20.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.403+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:37:20.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:37:20.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.415+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:37:20.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.426+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:37:20.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.428+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:37:20.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.430+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:37:20.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.446+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:37:20.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.455+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:37:20.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.475+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:20.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.506+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:37:20.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.514+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:37:20.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.523+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:37:20.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.537+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:37:20.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.549+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:37:20.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.549+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:37:20.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.581+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:37:20.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:37:20.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.602+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:37:20.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.611+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:37:20.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.619+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:37:20.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:37:20.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.638+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:37:20.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.638+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:37:20.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.656+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:37:20.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.670+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:37:20.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.674+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:37:20.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.675+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:37:20.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.685+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:37:20.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.697+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:37:20.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.701+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:37:20.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.709+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:37:20.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.725+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:37:20.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 57 15 773524 773509 848.071 831.75 0.000600277 0.00116833 2024-09-17T16:37:20.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.741+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:37:20.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.754+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:37:20.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.763+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:37:20.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.780+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:37:20.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.782+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:37:20.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.798+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:37:20.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.812+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:37:20.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:37:20.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.834+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:37:20.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.834+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:37:20.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.839+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:37:20.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.844+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:37:20.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.875+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:37:20.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.893+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:37:20.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.915+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:37:20.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.925+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:37:20.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.935+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:37:20.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.937+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:37:20.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.959+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:37:20.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.972+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:37:20.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.985+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:37:20.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.988+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:37:20.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:20.993+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:37:21.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.016+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:37:21.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.023+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:37:21.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.028+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:37:21.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.140+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:37:21.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.144+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:37:21.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.162+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:37:21.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.178+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:37:21.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.191+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:37:21.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.202+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:37:21.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.211+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:37:21.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.216+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:37:21.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.227+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:37:21.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.241+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:37:21.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.248+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:37:21.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.264+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:37:21.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.289+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:37:21.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.296+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:37:21.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.307+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:37:21.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.308+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:37:21.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.325+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:37:21.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.327+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:21.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.339+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:37:21.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.342+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:37:21.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.349+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:37:21.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.352+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:37:21.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.391+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:37:21.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.391+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:37:21.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:37:21.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.441+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:37:21.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.450+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:37:21.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.459+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:37:21.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.475+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:37:21.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.482+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:37:21.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.486+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:37:21.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.491+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:37:21.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.494+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:37:21.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.502+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:37:21.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.516+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:37:21.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.523+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:37:21.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.538+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:37:21.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.543+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:37:21.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.561+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:37:21.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.567+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:37:21.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.593+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:37:21.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.602+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:37:21.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.610+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:21.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.616+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:37:21.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.622+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:37:21.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:37:21.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:37:21.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.661+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:37:21.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.682+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:37:21.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.690+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:37:21.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.708+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:37:21.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.729+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:37:21.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.730+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:37:21.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 58 15 785927 785912 846.813 775.188 0.000732359 0.00117012 2024-09-17T16:37:21.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.757+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:37:21.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.782+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:37:21.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.787+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:37:21.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.814+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:37:21.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.827+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:37:21.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.846+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:37:21.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.852+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:37:21.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.852+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:37:21.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.855+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:37:21.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.870+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:37:21.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.891+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:37:21.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.909+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:37:21.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.913+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:37:21.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.914+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:37:21.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.941+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:37:21.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.949+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:37:21.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.955+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:37:21.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.983+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:37:21.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.994+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:22.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:21.998+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:37:22.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.024+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:37:22.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.048+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:37:22.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.059+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:37:22.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.064+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:37:22.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.068+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:22.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.084+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:37:22.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.113+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:37:22.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.119+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:37:22.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.138+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:37:22.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.148+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:37:22.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.155+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:37:22.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.157+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:37:22.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.163+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:37:22.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.170+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:37:22.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.183+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:37:22.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.189+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:37:22.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:37:22.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.246+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:37:22.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.248+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:37:22.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.250+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:37:22.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.290+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:37:22.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.311+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:37:22.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.319+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:22.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.323+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:37:22.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.328+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:37:22.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.349+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:22.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.352+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:37:22.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.355+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:37:22.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.381+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:37:22.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.385+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:37:22.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.403+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:37:22.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.421+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:37:22.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.421+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:37:22.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.439+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:37:22.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.448+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:37:22.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.455+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:37:22.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.464+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:37:22.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.466+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:37:22.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.478+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:37:22.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.499+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:37:22.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.512+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:37:22.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.545+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:37:22.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:37:22.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.557+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:22.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.570+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:37:22.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.579+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:37:22.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.580+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:37:22.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.586+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:37:22.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.602+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:37:22.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:37:22.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.641+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:37:22.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:37:22.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.645+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:37:22.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.666+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:37:22.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.670+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:37:22.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.674+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:22.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.715+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:37:22.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.726+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:37:22.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.738+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:37:22.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.739+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:37:22.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 59 16 800187 800171 847.563 891.188 0.000854788 0.00116908 2024-09-17T16:37:22.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.752+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:37:22.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.757+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:37:22.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.762+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:37:22.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.777+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:37:22.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.794+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:37:22.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.802+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:37:22.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.804+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:37:22.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.805+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:37:22.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.826+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:37:22.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.832+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:37:22.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:37:22.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.871+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:37:22.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.874+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:37:22.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.892+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:37:22.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.901+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:37:22.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.908+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:37:22.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.920+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:37:22.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.928+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:22.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.933+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:37:22.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.974+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:37:22.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.981+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:37:22.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.981+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:37:22.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.986+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:37:22.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.987+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:22.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:22.988+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:37:23.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.021+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:37:23.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.052+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:37:23.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.071+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:37:23.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.080+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:37:23.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.081+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:37:23.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.096+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:37:23.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.096+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:37:23.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.114+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:37:23.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.125+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:37:23.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.130+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:23.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.136+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:37:23.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.144+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:37:23.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.144+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:37:23.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.165+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:37:23.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.168+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:37:23.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:37:23.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.192+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:37:23.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.193+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:37:23.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.210+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:37:23.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.213+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:37:23.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.216+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:37:23.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.224+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:37:23.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.225+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:37:23.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.277+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:37:23.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.308+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:37:23.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.316+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:37:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.333+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:37:23.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.336+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:37:23.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.367+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:37:23.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.369+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:37:23.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.389+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:37:23.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.409+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:37:23.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.410+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:37:23.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.412+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:37:23.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.416+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:37:23.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.446+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:37:23.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.454+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:37:23.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.461+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:37:23.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.472+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:37:23.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.482+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:37:23.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.487+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:23.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.490+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:37:23.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.494+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:37:23.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.526+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:37:23.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.529+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:37:23.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.543+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:37:23.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.563+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:37:23.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.567+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:37:23.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.581+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:37:23.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:37:23.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.591+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:37:23.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.602+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:37:23.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.617+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:37:23.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.619+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:37:23.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.640+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:37:23.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.640+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:37:23.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.646+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:37:23.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.659+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:23.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.672+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:37:23.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.676+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:37:23.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.680+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:37:23.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.709+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:37:23.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.725+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:37:23.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.734+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:37:23.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:37:23.741136+0000 min lat: 0.000227768 max lat: 0.114701 avg lat: 0.00116875 2024-09-17T16:37:23.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:37:23.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 60 16 813977 813961 847.801 861.875 0.00134103 0.00116875 2024-09-17T16:37:23.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.746+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:37:23.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.756+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:37:23.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.761+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:37:23.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.764+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:37:23.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.780+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:37:23.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.795+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:37:23.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.801+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:37:23.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.815+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:23.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.824+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:37:23.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.831+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:37:23.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.848+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:37:23.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.863+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:37:23.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.874+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:37:23.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.881+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:37:23.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.886+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:37:23.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:37:23.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.897+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:37:23.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.907+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:37:23.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.913+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:37:23.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.932+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:23.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.943+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:37:23.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:37:23.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.960+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:37:23.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:23.975+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:24.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.008+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:37:24.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.018+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:37:24.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.029+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:37:24.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:37:24.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.037+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:37:24.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:37:24.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:37:24.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:37:24.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.077+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:37:24.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.078+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:37:24.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.109+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:37:24.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.124+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:37:24.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.137+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:37:24.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.140+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:37:24.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.145+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:37:24.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.167+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:37:24.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.172+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:37:24.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.180+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:37:24.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.184+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:37:24.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.186+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:37:24.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.225+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:37:24.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.226+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:37:24.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.234+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:37:24.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.240+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:24.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.248+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:37:24.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.275+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:37:24.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.276+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:37:24.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.287+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:37:24.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.290+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:37:24.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.295+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:24.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.309+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:37:24.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.328+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:37:24.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.335+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:24.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.336+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:37:24.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.344+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:37:24.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.356+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:37:24.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.382+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:24.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.386+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:37:24.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:37:24.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.398+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:37:24.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.409+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:37:24.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.427+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:37:24.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.437+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:37:24.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.453+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:37:24.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.464+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:37:24.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.474+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:37:24.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.493+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:24.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.504+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:37:24.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.505+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:37:24.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.510+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:24.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.533+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:37:24.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.543+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:37:24.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:37:24.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.568+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:37:24.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.590+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:37:24.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.591+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:37:24.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.598+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:37:24.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.624+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:37:24.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.632+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:37:24.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.637+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:37:24.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.650+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:37:24.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.663+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:37:24.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.664+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:37:24.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.673+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:37:24.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.686+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:37:24.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.693+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:37:24.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:37:24.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.739+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:37:24.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 61 16 827304 827288 847.556 832.938 0.000694018 0.0011691 2024-09-17T16:37:24.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.743+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:37:24.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.745+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:37:24.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.747+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:37:24.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.758+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:37:24.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.773+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:37:24.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.777+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:37:24.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.785+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:37:24.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.804+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:37:24.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.807+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:37:24.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.825+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:37:24.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.825+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:37:24.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.847+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:37:24.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.853+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:37:24.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.877+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:37:24.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.909+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:37:24.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.922+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:37:24.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.927+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:37:24.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.932+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:37:24.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.953+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:37:24.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.954+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:37:24.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.982+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:37:24.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.984+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:37:24.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.990+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:37:24.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:24.991+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:37:25.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.007+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:37:25.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.041+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:37:25.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.044+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:37:25.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.056+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:37:25.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.056+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:37:25.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.085+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:37:25.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.099+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:37:25.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.103+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:37:25.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:37:25.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.118+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:37:25.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.128+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:37:25.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.170+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:37:25.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.178+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:37:25.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.181+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:37:25.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.191+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:37:25.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.192+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:37:25.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.203+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:37:25.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.221+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:37:25.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.234+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:37:25.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.251+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:37:25.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.261+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:37:25.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.270+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:25.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.270+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:37:25.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.286+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:37:25.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:37:25.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.303+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:37:25.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.306+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:37:25.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.326+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:37:25.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.347+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:37:25.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.388+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:37:25.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.399+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:37:25.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.405+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:37:25.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.405+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:37:25.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.441+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:37:25.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.460+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:37:25.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.477+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:37:25.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.486+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:37:25.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.490+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:37:25.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.505+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:37:25.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.508+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:37:25.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.532+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:37:25.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.539+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:37:25.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.543+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:37:25.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:37:25.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.558+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:37:25.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.570+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:37:25.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.571+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:37:25.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.573+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:37:25.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.594+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:37:25.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.613+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:37:25.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.630+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:37:25.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.634+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:37:25.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.659+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:37:25.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.661+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:37:25.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.664+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:37:25.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.683+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:37:25.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.683+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:37:25.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.706+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:37:25.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.715+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:37:25.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.728+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:37:25.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.734+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:37:25.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 62 16 840875 840859 847.565 848.188 0.000592875 0.00116907 2024-09-17T16:37:25.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.745+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:37:25.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.747+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:37:25.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.766+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:37:25.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.774+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:37:25.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.785+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:37:25.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.796+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:37:25.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.805+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:37:25.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.814+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:37:25.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.845+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:37:25.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.865+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:37:25.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.868+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:37:25.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.880+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:37:25.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.900+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:37:25.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.902+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:37:25.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.906+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:37:25.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.909+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:37:25.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.931+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:37:25.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.938+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:37:25.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.949+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:37:25.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.980+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:37:25.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:25.983+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:37:26.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.018+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:37:26.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.023+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:26.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.030+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:37:26.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.031+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:37:26.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.031+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:37:26.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.034+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:37:26.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.047+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:37:26.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.066+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:37:26.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.076+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:37:26.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.088+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:37:26.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.176+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:37:26.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.177+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:37:26.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.179+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:37:26.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.190+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:26.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.198+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:37:26.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.208+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:26.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.210+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:37:26.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.239+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:37:26.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.251+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:37:26.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.254+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:37:26.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.259+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:37:26.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:37:26.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.272+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:37:26.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.307+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:37:26.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.327+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:37:26.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.328+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:37:26.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.333+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:37:26.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.357+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:37:26.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.369+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:37:26.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.370+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:37:26.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.371+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:37:26.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.380+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:37:26.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.387+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:37:26.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.404+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:37:26.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.405+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:37:26.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:26.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:37:26.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.463+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:37:26.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.470+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:37:26.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.491+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:37:26.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.508+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:37:26.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.510+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:37:26.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.511+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:37:26.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.522+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:37:26.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.524+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:37:26.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.546+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:37:26.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.571+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:37:26.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.576+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:37:26.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.594+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:37:26.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.614+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:37:26.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:37:26.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.646+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:26.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.647+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:37:26.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.658+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:37:26.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.658+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:37:26.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.677+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:37:26.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.686+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:37:26.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.700+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:37:26.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 63 16 853761 853745 846.894 805.375 0.000844896 0.00117003 2024-09-17T16:37:26.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.751+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:37:26.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.758+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:37:26.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.773+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:37:26.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.775+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:37:26.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.790+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:37:26.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.811+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:26.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.825+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:37:26.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.826+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:37:26.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.834+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:37:26.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.839+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:37:26.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.858+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:26.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.868+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:37:26.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.873+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:37:26.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.879+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:37:26.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.905+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:37:26.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.912+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:37:26.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.913+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:37:26.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.930+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:37:26.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.940+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:37:26.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:37:26.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.967+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:37:26.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:26.983+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:37:27.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.016+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:37:27.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.020+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:37:27.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.026+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:37:27.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.026+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:37:27.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.029+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:37:27.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.063+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:37:27.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.063+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:37:27.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.074+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:37:27.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.091+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:37:27.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.101+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:37:27.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.113+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:37:27.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.130+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:37:27.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.133+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:37:27.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.146+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:37:27.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.152+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:37:27.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.158+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:37:27.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.171+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:37:27.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.171+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:27.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.179+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:37:27.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.187+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:27.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.199+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:37:27.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.210+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:37:27.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.211+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:37:27.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.240+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:37:27.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.248+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:37:27.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.249+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:37:27.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.259+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:37:27.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.269+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:37:27.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.277+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:37:27.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.283+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:37:27.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.301+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:37:27.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.313+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:37:27.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.323+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:37:27.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.335+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:37:27.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.343+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:37:27.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.364+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:37:27.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.365+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:37:27.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.397+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:27.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.402+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:37:27.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.419+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:37:27.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.429+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:37:27.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.438+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:37:27.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.442+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:37:27.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.455+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:37:27.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.460+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:37:27.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:37:27.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.511+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:37:27.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.514+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:37:27.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.524+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:37:27.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.548+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:37:27.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.557+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:37:27.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.561+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:37:27.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.564+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:37:27.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.593+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:37:27.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.596+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:27.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.617+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:37:27.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.618+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:37:27.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.625+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:37:27.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.638+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:37:27.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.677+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:37:27.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.682+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:37:27.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.695+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:37:27.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.707+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:37:27.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.730+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:37:27.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.737+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:37:27.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 64 16 867601 867585 847.176 865 0.000984406 0.00116962 2024-09-17T16:37:27.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.749+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:37:27.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.756+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:37:27.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.776+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:37:27.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.778+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:37:27.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.780+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:37:27.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.807+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:37:27.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:37:27.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.826+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:37:27.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.849+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:37:27.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.854+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:27.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.897+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:27.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.900+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:37:27.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.900+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:37:27.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.929+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:37:27.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:37:27.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.937+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:37:27.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:37:27.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.965+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:37:27.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:27.991+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:37:28.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.016+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:37:28.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.019+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:37:28.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.023+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:37:28.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.024+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:37:28.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.033+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:37:28.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.050+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:28.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.060+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:37:28.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.071+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:37:28.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:37:28.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.107+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:37:28.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.108+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:37:28.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.134+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:37:28.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.143+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:37:28.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:28.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.150+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:37:28.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.165+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:37:28.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.188+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:37:28.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.190+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:37:28.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.214+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:37:28.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.222+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:37:28.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.227+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:37:28.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.235+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:37:28.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.236+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:37:28.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.263+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:37:28.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.283+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:37:28.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.307+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:37:28.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.309+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:37:28.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.310+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:37:28.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.310+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:37:28.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.336+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:37:28.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.343+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:37:28.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.367+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:37:28.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.371+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:37:28.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.375+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:37:28.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.378+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:37:28.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.391+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:37:28.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.409+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:37:28.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.422+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:37:28.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.437+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:37:28.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.438+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:37:28.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.445+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:37:28.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.471+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:37:28.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.472+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:37:28.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.478+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:37:28.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.485+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:37:28.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.508+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:37:28.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.514+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:37:28.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.525+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:37:28.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.549+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:37:28.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.550+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:37:28.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.559+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:37:28.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.579+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:37:28.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.586+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:37:28.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.593+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:37:28.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.594+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:37:28.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.638+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:37:28.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.644+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:37:28.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.657+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:37:28.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.665+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:37:28.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.672+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:37:28.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.674+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:37:28.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.695+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:37:28.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.710+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:37:28.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.712+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:37:28.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.722+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:37:28.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 65 15 881407 881392 847.418 862.938 0.00100421 0.00116927 2024-09-17T16:37:28.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.742+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:37:28.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.764+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:37:28.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.774+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:37:28.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.781+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:37:28.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.786+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:37:28.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.805+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:37:28.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.807+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:37:28.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.815+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:37:28.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.821+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:37:28.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.828+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:37:28.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.843+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:37:28.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.862+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:37:28.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.884+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:37:28.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:37:28.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.899+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:37:28.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.906+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:37:28.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.912+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:37:28.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.926+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:37:28.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.935+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:37:28.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.939+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:37:28.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.948+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:37:28.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.953+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:37:28.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.969+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:37:28.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.984+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:37:28.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:28.996+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:37:29.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.009+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:37:29.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.034+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:37:29.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.037+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:37:29.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.045+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:37:29.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.058+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:37:29.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:37:29.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.093+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:37:29.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.104+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:37:29.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.106+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:29.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.144+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:37:29.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.149+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:37:29.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.165+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:37:29.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:29.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.181+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:29.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:37:29.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.190+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:37:29.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.213+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:37:29.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.216+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:29.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.243+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:37:29.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.243+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:37:29.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.268+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:37:29.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.271+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:37:29.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.282+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:37:29.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.294+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:37:29.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.295+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:37:29.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.309+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:37:29.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.333+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:37:29.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.333+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:37:29.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.338+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:37:29.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.358+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:37:29.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.375+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:37:29.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.383+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:37:29.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.393+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:29.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.409+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:37:29.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.410+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:37:29.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.442+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:37:29.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.462+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:37:29.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.467+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:37:29.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.476+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:37:29.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.479+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:37:29.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.496+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:37:29.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.502+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:37:29.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.510+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:37:29.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.519+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:37:29.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.523+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:37:29.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.548+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:37:29.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.549+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:37:29.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.562+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:37:29.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.563+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:37:29.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.580+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:29.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.588+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:37:29.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.595+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:29.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.609+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:37:29.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.631+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:37:29.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.635+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:37:29.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.636+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:37:29.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.649+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:37:29.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.662+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:29.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.663+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:37:29.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.682+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:37:29.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.688+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:37:29.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.692+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:37:29.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.737+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:37:29.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 66 16 895056 895040 847.501 853 0.000773628 0.00116917 2024-09-17T16:37:29.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.741+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:37:29.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.770+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:37:29.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.777+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:37:29.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.796+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:37:29.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.802+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:37:29.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.806+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:37:29.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.811+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:37:29.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.839+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:37:29.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.852+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:37:29.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.858+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:37:29.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.859+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:37:29.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.871+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:37:29.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.886+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:37:29.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.905+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:37:29.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.935+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:37:29.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.953+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:37:29.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.956+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:37:29.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.972+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:37:29.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.982+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:37:29.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:29.996+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:37:30.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.004+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:37:30.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.013+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:37:30.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.022+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:37:30.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.033+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:37:30.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.043+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:37:30.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.046+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:37:30.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.059+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:37:30.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.067+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:37:30.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.071+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:37:30.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.090+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:37:30.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.103+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:37:30.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:37:30.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.132+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:37:30.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.134+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:37:30.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.168+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:37:30.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.184+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:30.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.195+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:37:30.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.201+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:37:30.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:37:30.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.232+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:37:30.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.249+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:37:30.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.250+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:37:30.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.251+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:37:30.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.279+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:37:30.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.287+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:37:30.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.308+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:37:30.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.317+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:37:30.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.328+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:37:30.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.328+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:37:30.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.332+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:37:30.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.356+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:37:30.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.373+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:37:30.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.376+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:37:30.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.390+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:30.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.395+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:37:30.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.403+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:37:30.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:37:30.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.432+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:37:30.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.441+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:37:30.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.463+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:37:30.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.468+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:37:30.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.468+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:37:30.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.474+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:37:30.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.480+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:37:30.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.486+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:37:30.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.495+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:37:30.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.509+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:30.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.525+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:37:30.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.545+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:37:30.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.557+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:37:30.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.570+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:37:30.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.576+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:37:30.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.600+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:37:30.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.605+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:37:30.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:37:30.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.624+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:37:30.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.635+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:37:30.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.636+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:37:30.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.638+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:37:30.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.647+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:37:30.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.655+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:37:30.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.663+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:37:30.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.695+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:37:30.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.707+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:37:30.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.712+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:37:30.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.731+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:37:30.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.732+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:37:30.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.736+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:37:30.742 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 67 16 909087 909071 847.939 876.938 0.00139908 0.00116854 2024-09-17T16:37:30.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.746+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:37:30.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.762+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:37:30.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.764+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:37:30.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.772+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:37:30.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.785+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:37:30.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.792+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:37:30.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.818+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:37:30.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.824+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:37:30.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.837+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:37:30.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.849+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:37:30.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.855+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:30.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:37:30.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.866+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:37:30.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.882+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:37:30.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.893+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:37:30.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.912+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:37:30.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.922+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:37:30.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.939+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:37:30.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.941+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:37:30.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.944+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:37:30.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.954+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:37:30.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.956+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:37:30.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.989+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:37:30.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:30.994+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:37:31.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.005+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:37:31.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.017+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:37:31.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.031+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:37:31.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.034+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:37:31.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.034+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:37:31.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.067+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:37:31.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.069+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:37:31.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.071+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:37:31.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.107+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:37:31.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.121+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:37:31.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.121+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:37:31.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.139+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:37:31.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.161+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:37:31.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.184+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:37:31.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.189+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:37:31.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.190+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:37:31.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.219+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:37:31.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.223+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:31.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.235+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:31.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.237+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:37:31.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.245+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:37:31.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.260+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:37:31.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:37:31.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.296+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:37:31.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.305+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:37:31.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.312+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:37:31.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.315+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:37:31.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.339+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:37:31.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.340+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:37:31.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.365+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:37:31.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.379+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:37:31.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.381+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:37:31.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.409+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:37:31.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.409+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:37:31.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:37:31.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.442+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:37:31.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.445+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:37:31.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.464+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:37:31.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.464+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:37:31.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.482+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:37:31.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.485+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:37:31.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.504+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:37:31.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.507+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:37:31.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.549+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:37:31.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.554+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:37:31.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.583+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:37:31.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.589+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:37:31.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.601+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:37:31.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.617+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:37:31.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.619+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:37:31.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.642+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:37:31.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.650+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:37:31.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.669+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:37:31.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.673+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:37:31.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.674+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:37:31.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.685+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:31.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.704+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:37:31.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.724+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:37:31.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.731+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:37:31.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 68 16 923227 923211 848.465 883.75 0.000852896 0.00116782 2024-09-17T16:37:31.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.752+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:37:31.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.768+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:37:31.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.770+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:37:31.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.775+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:37:31.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.777+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:37:31.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.788+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:37:31.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.798+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:37:31.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.843+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:37:31.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.848+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:37:31.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.851+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:37:31.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.865+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:37:31.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.877+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:37:31.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.885+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:37:31.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.910+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:37:31.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.912+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:37:31.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.912+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:37:31.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.937+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:37:31.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.946+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:37:31.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.954+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:37:31.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.957+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:37:31.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.978+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:37:31.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.983+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:37:31.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:31.993+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:37:32.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.007+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:37:32.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.025+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:37:32.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:37:32.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.054+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:37:32.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.059+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:37:32.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.067+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:37:32.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.101+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:37:32.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:37:32.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.108+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:37:32.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.126+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:37:32.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.127+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:37:32.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:37:32.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.155+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:37:32.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.162+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:32.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.163+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:37:32.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.169+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:37:32.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.193+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:37:32.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.207+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:37:32.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.228+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:37:32.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.228+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:37:32.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.237+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:37:32.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.240+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:37:32.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.266+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:37:32.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.292+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:37:32.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.292+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:37:32.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.293+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:37:32.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.341+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:37:32.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.368+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:37:32.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.369+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:37:32.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.384+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:37:32.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.398+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:37:32.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.407+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:37:32.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.414+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:37:32.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:37:32.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.425+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:37:32.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.439+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:37:32.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.449+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:37:32.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.458+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:37:32.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:37:32.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.498+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:37:32.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.513+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:37:32.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.518+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:37:32.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.531+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:37:32.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.539+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:37:32.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.548+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:37:32.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.570+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:37:32.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.571+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:37:32.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.581+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:37:32.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.588+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:37:32.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.625+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:37:32.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.634+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:37:32.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.648+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:37:32.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.657+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:37:32.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.665+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:37:32.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.668+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:37:32.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:37:32.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.680+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:37:32.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.693+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:32.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.706+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:37:32.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.715+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:37:32.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.722+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:37:32.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.736+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:37:32.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 69 16 937015 936999 848.656 861.75 0.000680795 0.00116752 2024-09-17T16:37:32.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.742+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:37:32.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.764+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:37:32.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.770+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:37:32.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.777+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:37:32.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.783+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:37:32.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.792+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:32.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.792+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:37:32.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.806+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:37:32.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.844+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:37:32.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.856+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:37:32.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.860+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:37:32.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.872+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:37:32.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.881+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:37:32.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.882+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:32.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.903+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:37:32.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.907+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:37:32.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.930+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:37:32.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:37:32.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.944+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:32.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.951+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:32.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.953+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:37:32.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.957+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:37:32.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.978+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:37:32.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.985+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:37:32.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.988+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:37:32.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:32.991+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:37:33.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.001+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:37:33.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.025+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:37:33.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.046+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:37:33.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.052+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:37:33.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.063+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:33.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.075+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:37:33.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.085+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:37:33.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.092+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:37:33.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:37:33.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.107+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:37:33.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.113+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:37:33.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.115+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:37:33.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.149+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:37:33.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.166+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:37:33.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:37:33.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.178+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:37:33.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.182+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:37:33.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.211+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:37:33.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.234+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:37:33.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.234+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:37:33.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.236+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:37:33.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.240+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:37:33.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.283+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:37:33.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.303+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:37:33.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.304+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:37:33.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.315+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:37:33.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.320+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:37:33.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.324+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:37:33.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.347+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:37:33.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.360+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:37:33.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:37:33.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.380+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:37:33.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.405+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:37:33.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.407+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:37:33.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.408+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:37:33.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.413+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:37:33.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.417+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:37:33.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.456+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:37:33.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.472+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:37:33.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.515+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:37:33.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:37:33.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.534+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:37:33.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.541+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:37:33.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.554+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:37:33.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.556+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:37:33.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.575+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:37:33.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.601+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:37:33.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.605+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:37:33.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.609+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:37:33.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.615+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:37:33.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.633+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:37:33.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.638+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:37:33.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.651+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:37:33.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.657+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:37:33.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.669+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:33.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.687+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:37:33.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.689+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:37:33.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.701+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:37:33.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.711+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:37:33.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.713+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:37:33.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.717+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:37:33.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 70 16 950803 950787 848.842 861.75 0.000682686 0.00116725 2024-09-17T16:37:33.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.756+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:37:33.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.770+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:37:33.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.774+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:37:33.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.801+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:37:33.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.810+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:37:33.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.810+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:37:33.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.811+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:37:33.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.826+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:37:33.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.841+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:37:33.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.850+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:37:33.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.860+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:37:33.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.868+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:37:33.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.873+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:37:33.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.877+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:37:33.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.887+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:37:33.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.912+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:37:33.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.939+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:37:33.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.941+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:37:33.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:37:33.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.962+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:37:33.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.965+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:37:33.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.971+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:37:33.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.994+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:37:34.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:33.999+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:37:34.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.015+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:37:34.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.031+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:37:34.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.035+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:37:34.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.062+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:37:34.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.067+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:37:34.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.073+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:37:34.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.081+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:37:34.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.087+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:37:34.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.100+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:37:34.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.116+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:37:34.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.125+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:37:34.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.141+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:37:34.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.163+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:37:34.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.167+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:34.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.168+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:34.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.204+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:37:34.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:37:34.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.239+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:37:34.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.249+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:37:34.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.251+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:34.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.271+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:37:34.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.272+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:37:34.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.281+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:37:34.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.291+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:37:34.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.318+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:37:34.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.333+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:37:34.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.344+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:37:34.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.347+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:37:34.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.364+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:37:34.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.371+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:37:34.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.388+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:37:34.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.397+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:37:34.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.398+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:37:34.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.399+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:37:34.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.410+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:37:34.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:37:34.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.438+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:37:34.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.439+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:37:34.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.461+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:37:34.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.465+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:37:34.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.483+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:37:34.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.486+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:37:34.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.503+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:37:34.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.510+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:37:34.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.529+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:37:34.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.532+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:37:34.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.532+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:34.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.544+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:37:34.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.560+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:37:34.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.564+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:37:34.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.591+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:37:34.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.595+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:37:34.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.605+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:37:34.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.609+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:37:34.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.626+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:37:34.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.634+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:37:34.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.664+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:37:34.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.671+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:34.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.688+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:37:34.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.689+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:37:34.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.697+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:37:34.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.717+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:37:34.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.717+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:37:34.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.722+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:37:34.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 71 16 964503 964487 848.945 856.25 0.000702629 0.00116714 2024-09-17T16:37:34.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.750+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:37:34.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.767+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:37:34.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.786+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:37:34.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.787+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:37:34.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.799+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:37:34.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.806+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:37:34.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.807+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:37:34.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.832+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:37:34.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.839+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:37:34.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.857+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:37:34.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.868+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:37:34.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.875+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:37:34.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.886+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:37:34.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:37:34.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.904+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:37:34.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.905+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:37:34.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.915+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:37:34.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.920+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:37:34.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.925+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:37:34.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.930+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:37:34.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.952+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:37:34.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.959+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:37:34.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:34.969+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:37:35.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.006+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:37:35.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.031+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:37:35.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.032+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:37:35.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.038+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:37:35.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.071+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:37:35.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:37:35.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.092+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:37:35.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.093+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:37:35.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:37:35.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.126+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:37:35.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.127+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:37:35.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.176+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:37:35.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:37:35.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.222+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:37:35.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.240+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:37:35.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.243+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:37:35.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.249+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:37:35.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.259+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:37:35.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.267+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:37:35.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.294+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:37:35.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.297+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:37:35.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.312+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:37:35.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.322+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:37:35.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.366+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:37:35.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.370+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:37:35.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.390+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:37:35.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.393+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:37:35.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.410+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:37:35.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.414+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:37:35.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.419+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:37:35.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.448+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:37:35.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.453+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:37:35.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.463+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:37:35.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.470+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:37:35.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.484+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:37:35.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.489+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:37:35.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.492+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:37:35.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.495+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:37:35.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.508+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:37:35.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.529+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:37:35.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.529+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:37:35.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.535+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:37:35.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.551+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:37:35.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.554+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:37:35.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.578+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:37:35.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.594+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:37:35.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.596+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:37:35.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.621+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:37:35.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.623+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:35.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.637+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:37:35.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.652+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:37:35.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.656+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:37:35.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.662+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:37:35.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.704+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:37:35.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.709+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:37:35.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.718+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:37:35.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.726+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:37:35.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.730+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:37:35.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 72 16 977862 977846 848.75 834.938 0.000734349 0.00116741 2024-09-17T16:37:35.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.742+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:37:35.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.760+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:37:35.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.769+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:37:35.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.795+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:37:35.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.797+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:37:35.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.799+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:37:35.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.811+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:37:35.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.823+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:37:35.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.846+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:35.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.854+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:37:35.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.864+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:37:35.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.891+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:37:35.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:37:35.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.901+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:37:35.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.908+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:35.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.913+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:37:35.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.927+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:37:35.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.961+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:37:35.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.969+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:37:35.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.970+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:35.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.984+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:37:35.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.988+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:37:35.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:35.996+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:37:36.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.000+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:37:36.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.003+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:37:36.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.036+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:37:36.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.047+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:37:36.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:37:36.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.093+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:37:36.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.104+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:37:36.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.129+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:37:36.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.198+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:37:36.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.230+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:37:36.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.243+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:37:36.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.245+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:37:36.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.259+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:37:36.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.269+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:37:36.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.282+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:37:36.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.286+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:37:36.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.294+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:37:36.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.302+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:37:36.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.305+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:37:36.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.309+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:37:36.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.322+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:37:36.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.341+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:37:36.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.342+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:37:36.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.342+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:37:36.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.348+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:37:36.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.403+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:37:36.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.408+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:37:36.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.434+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:37:36.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.436+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:37:36.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.439+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:37:36.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.451+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:37:36.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.466+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:37:36.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.498+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:37:36.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.507+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:37:36.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.510+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:37:36.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.512+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:37:36.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.521+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:37:36.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.527+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:37:36.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.559+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:37:36.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.574+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:37:36.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.585+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:37:36.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.596+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:37:36.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.613+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:37:36.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.616+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:37:36.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:37:36.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.648+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:37:36.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.652+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:37:36.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.669+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:37:36.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.672+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:36.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.692+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:37:36.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.721+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:36.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.729+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:37:36.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 73 15 991047 991032 848.412 824.125 0.000686069 0.00116789 2024-09-17T16:37:36.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.755+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:37:36.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.758+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:37:36.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.764+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:37:36.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.769+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:37:36.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.792+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:37:36.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.804+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:37:36.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.807+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:37:36.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.810+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:37:36.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.827+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:37:36.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.847+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:37:36.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.856+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:37:36.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.857+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:37:36.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.868+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:37:36.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.890+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:37:36.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.908+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:37:36.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.920+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:37:36.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.923+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:37:36.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.946+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:37:36.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.954+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:37:36.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:37:36.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:36.997+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:37:37.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.005+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:37:37.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.017+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:37:37.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.019+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:37:37.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.023+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:37:37.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.025+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:37:37.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.036+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:37.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.055+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:37:37.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.071+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:37:37.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.075+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:37:37.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.080+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:37:37.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.107+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:37:37.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.119+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:37:37.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.128+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:37:37.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.147+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:37.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.155+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:37:37.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.160+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:37:37.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:37:37.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.179+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:37:37.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.190+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:37:37.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.218+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:37:37.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.222+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:37:37.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.223+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:37:37.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:37:37.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.245+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:37:37.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.246+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:37:37.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.272+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:37:37.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.278+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:37:37.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.288+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:37:37.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.293+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:37:37.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:37:37.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.371+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:37:37.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.381+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:37:37.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.385+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:37:37.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.401+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:37:37.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.409+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:37.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.428+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:37:37.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.430+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:37:37.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.452+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:37:37.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.458+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:37:37.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.461+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:37:37.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.476+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:37:37.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.485+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:37:37.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.505+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:37:37.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.512+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:37:37.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.516+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:37:37.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.532+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:37:37.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.538+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:37:37.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.544+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:37:37.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.561+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:37:37.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.568+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:37.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.569+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:37.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.578+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:37:37.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.597+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:37:37.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:37:37.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.603+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:37:37.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.624+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:37:37.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.627+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:37:37.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.634+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:37:37.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.637+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:37:37.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.652+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:37:37.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.661+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:37:37.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.677+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:37:37.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.699+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:37:37.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.705+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:37:37.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.732+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:37:37.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 74 16 1004743 1004727 848.512 855.938 0.000896787 0.00116775 2024-09-17T16:37:37.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.742+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:37:37.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.745+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:37:37.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.758+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:37:37.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.769+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:37:37.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.778+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:37:37.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.798+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:37:37.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.810+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:37:37.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.821+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:37:37.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.831+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:37:37.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.840+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:37.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.843+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:37:37.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.855+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:37:37.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.869+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:37:37.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.871+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:37:37.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.916+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:37:37.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.928+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:37:37.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.953+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:37:37.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.956+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:37:37.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.966+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:37:37.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.969+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:37:37.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.977+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:37:37.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:37.992+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:37:38.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.010+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:37:38.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.010+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:38.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.019+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:37:38.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.019+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:37:38.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.027+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:37:38.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.033+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:38.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.047+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:37:38.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.058+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:37:38.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.081+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:37:38.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.095+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:37:38.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.103+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:37:38.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.104+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:37:38.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.124+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:37:38.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.128+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:37:38.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.136+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:37:38.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.146+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:37:38.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.156+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:37:38.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.165+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:37:38.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.168+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:37:38.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.183+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:37:38.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:37:38.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.218+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:37:38.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.224+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:37:38.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.246+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:37:38.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.254+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:37:38.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.263+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:37:38.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.267+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:37:38.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.306+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:37:38.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.309+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:37:38.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:37:38.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.315+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:37:38.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.320+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:37:38.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.342+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:37:38.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.353+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:37:38.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.372+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:37:38.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.387+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:37:38.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.401+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:37:38.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:37:38.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.415+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:37:38.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:37:38.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.437+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:37:38.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.456+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:37:38.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.460+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:37:38.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.470+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:37:38.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.483+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:37:38.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.490+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:37:38.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.509+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:37:38.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.525+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:37:38.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.526+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:37:38.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.531+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:37:38.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.539+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:37:38.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.565+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:37:38.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.596+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:37:38.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.618+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:37:38.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.618+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:37:38.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.624+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:37:38.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.655+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:37:38.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.656+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:37:38.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.662+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:37:38.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.672+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:37:38.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.672+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:37:38.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.705+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:38.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.712+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:37:38.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.721+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:37:38.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.734+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:37:38.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.740+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:37:38.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.741+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:37:38.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 75 15 1018486 1018471 848.651 859 0.00090536 0.00116757 2024-09-17T16:37:38.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.752+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:37:38.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.781+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:37:38.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.791+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:37:38.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.794+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:37:38.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.794+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:38.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.811+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:37:38.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.823+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:37:38.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.854+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:37:38.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.884+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:37:38.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.890+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:37:38.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.920+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:37:38.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.924+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:38.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.937+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:37:38.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.942+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:38.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.959+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:37:38.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.977+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:37:38.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:38.979+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:37:39.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.010+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:37:39.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.021+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:37:39.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.037+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:37:39.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.044+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:37:39.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.056+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:37:39.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.080+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:37:39.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.096+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:37:39.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.120+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:37:39.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.138+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:37:39.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.141+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:37:39.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.155+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:37:39.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.169+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:37:39.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.182+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:37:39.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.196+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:39.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.197+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:37:39.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.222+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:37:39.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.230+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:37:39.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.241+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:37:39.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.249+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:37:39.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.264+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:37:39.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.270+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:37:39.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.279+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:37:39.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:37:39.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.305+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:37:39.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.318+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:37:39.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.336+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:37:39.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.338+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:37:39.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.339+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:37:39.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.361+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:37:39.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.366+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:39.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.376+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:37:39.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.408+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:37:39.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.434+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:37:39.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.447+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:37:39.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.458+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:37:39.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.468+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:37:39.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.479+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:37:39.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.493+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:39.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.499+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:37:39.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.505+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:37:39.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.507+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:39.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.509+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:37:39.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.511+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:37:39.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.523+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:37:39.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.556+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:37:39.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.572+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:37:39.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.572+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:37:39.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.572+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:37:39.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.600+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:37:39.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.601+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:37:39.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.627+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:37:39.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.631+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:37:39.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.642+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:37:39.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.645+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:37:39.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:37:39.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.649+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:37:39.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.658+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:37:39.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:39.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.675+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:37:39.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.707+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:37:39.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.725+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:37:39.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.725+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:37:39.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.731+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:37:39.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 76 16 1032587 1032571 849.079 881.25 0.00079402 0.00116695 2024-09-17T16:37:39.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.761+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:37:39.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.801+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:37:39.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.801+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:37:39.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.816+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:37:39.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.833+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:37:39.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.847+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:37:39.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.873+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:37:39.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.896+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:37:39.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.906+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:37:39.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.908+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:37:39.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.914+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:37:39.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.915+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:37:39.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.944+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:37:39.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.971+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:37:39.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.974+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:37:39.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:39.993+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:37:40.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.011+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:37:40.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.048+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:37:40.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.051+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:40.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.053+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:37:40.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.058+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:37:40.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.066+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:37:40.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.067+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:37:40.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.099+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:37:40.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.117+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:37:40.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.129+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:37:40.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.132+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:37:40.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.140+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:37:40.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.149+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:37:40.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.162+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:37:40.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.169+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:37:40.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.170+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:37:40.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.187+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:37:40.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.189+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:37:40.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.208+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:37:40.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.234+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:37:40.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.242+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:37:40.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.253+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:37:40.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:37:40.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.270+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:37:40.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.272+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:37:40.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.288+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:37:40.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.290+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:37:40.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.306+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:37:40.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.314+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:37:40.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.331+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:37:40.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.338+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:37:40.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.352+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:37:40.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.353+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:37:40.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:37:40.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.370+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:37:40.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.402+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:37:40.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.415+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:37:40.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.421+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:37:40.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.439+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:37:40.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.441+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:37:40.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.450+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:37:40.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.451+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:37:40.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.465+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:37:40.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.471+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:37:40.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.500+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:37:40.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.506+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:37:40.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.517+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:37:40.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.525+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:37:40.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.544+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:37:40.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.567+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:37:40.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.567+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:37:40.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.582+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:37:40.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.602+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:37:40.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.608+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:37:40.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.624+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:37:40.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.633+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:37:40.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.653+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:37:40.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.660+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:37:40.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.668+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:37:40.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.690+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:37:40.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.708+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:37:40.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.715+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:37:40.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:37:40.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.732+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:37:40.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.733+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:37:40.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 77 15 1046816 1046801 849.601 889.375 0.00217698 0.00116623 2024-09-17T16:37:40.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.755+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:37:40.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.761+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:37:40.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.772+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:37:40.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.785+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:37:40.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.825+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:37:40.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.848+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:37:40.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.849+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:40.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.858+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:37:40.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:37:40.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.871+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:37:40.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.875+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:37:40.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:37:40.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.908+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:37:40.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.911+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:37:40.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.934+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:37:40.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.950+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:37:40.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.952+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:37:40.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.958+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:37:40.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.963+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:37:40.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:40.993+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:37:41.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.002+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:37:41.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.016+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:37:41.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.026+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:37:41.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.033+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:37:41.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.043+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:37:41.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.060+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:37:41.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.065+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:37:41.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.078+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:37:41.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.082+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:37:41.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.099+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:41.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.113+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:37:41.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.120+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:37:41.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.125+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:37:41.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.136+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:37:41.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.136+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:37:41.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.167+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:37:41.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.170+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:37:41.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.179+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:37:41.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.196+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:37:41.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.201+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:37:41.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.240+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:37:41.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.240+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:37:41.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.255+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:37:41.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.259+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:37:41.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.269+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:37:41.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.284+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:37:41.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.288+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:37:41.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.299+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:37:41.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.312+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:37:41.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.318+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:37:41.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.321+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:37:41.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.328+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:37:41.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.361+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:37:41.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.401+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:37:41.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.419+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:37:41.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.432+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:37:41.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.443+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:37:41.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.459+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:37:41.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.466+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:37:41.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.475+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:37:41.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.479+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:37:41.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.500+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:37:41.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.501+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:37:41.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.513+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:37:41.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.532+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:37:41.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.540+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:37:41.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.558+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:37:41.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.562+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:37:41.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.568+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:37:41.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.583+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:37:41.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.592+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:37:41.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.593+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:37:41.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.594+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:37:41.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.597+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:37:41.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.618+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:37:41.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.622+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:37:41.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.631+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:37:41.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.655+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:37:41.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.660+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:37:41.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:37:41.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.671+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:37:41.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.673+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:41.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.695+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:41.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.706+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:37:41.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.719+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:37:41.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.725+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:37:41.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 78 16 1060757 1060741 849.878 871.25 0.000585677 0.00116582 2024-09-17T16:37:41.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.754+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:37:41.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.777+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:41.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.779+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:37:41.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.793+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:37:41.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.800+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:37:41.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.803+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:37:41.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.806+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:37:41.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.842+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:37:41.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.855+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:37:41.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.871+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:37:41.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.872+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:37:41.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.875+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:37:41.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.878+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:37:41.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.911+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:37:41.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.925+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:37:41.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.926+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:37:41.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.941+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:37:41.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.951+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:37:41.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.964+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:37:41.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.965+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:37:41.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.973+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:37:41.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.987+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:37:41.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:41.992+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:37:42.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.000+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:37:42.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.014+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:37:42.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.014+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:37:42.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.031+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:37:42.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.037+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:37:42.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.041+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:37:42.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.070+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:42.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.075+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:37:42.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.075+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:37:42.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:37:42.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.093+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:37:42.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.110+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:37:42.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.131+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:37:42.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.136+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:37:42.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.142+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:37:42.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.147+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:37:42.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.158+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:37:42.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.164+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:37:42.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.180+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:37:42.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.201+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:37:42.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.215+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:37:42.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.226+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:37:42.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.245+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:37:42.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.249+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:37:42.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.264+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:37:42.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.267+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:37:42.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.268+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:37:42.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.272+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:37:42.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.277+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:37:42.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.312+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:37:42.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.313+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:37:42.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.315+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:37:42.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.340+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:37:42.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.368+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:37:42.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.370+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:37:42.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.391+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:37:42.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.399+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:37:42.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.422+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:37:42.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.429+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:37:42.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.449+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:37:42.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.458+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:37:42.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.467+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:37:42.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:37:42.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.486+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:37:42.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.488+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:37:42.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.508+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:37:42.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.516+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:37:42.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.521+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:37:42.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.554+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:37:42.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.592+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:37:42.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.603+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:37:42.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.619+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:37:42.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.619+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:37:42.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.620+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:37:42.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.629+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:42.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.639+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:37:42.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.663+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:37:42.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.665+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:37:42.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.673+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:37:42.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.695+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:37:42.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.706+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:37:42.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.707+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:37:42.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.717+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:37:42.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.721+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:37:42.743 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 79 16 1074662 1074646 850.12 869.062 0.000865616 0.00116546 2024-09-17T16:37:42.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.768+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:37:42.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.782+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:37:42.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.783+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:37:42.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.788+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:37:42.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.795+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:37:42.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.796+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:37:42.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:37:42.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.831+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:37:42.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.834+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:37:42.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.850+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:42.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.863+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:37:42.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.876+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:37:42.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.878+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:37:42.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.897+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:37:42.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.901+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:37:42.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.911+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:37:42.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.916+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:37:42.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.921+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:37:42.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.936+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:37:42.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.938+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:37:42.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.982+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:37:42.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.982+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:37:42.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:42.995+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:37:43.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.018+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:37:43.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.023+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:37:43.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.040+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:43.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.044+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:37:43.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.051+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:37:43.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.063+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:37:43.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.074+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:37:43.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.086+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:37:43.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.086+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:37:43.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:37:43.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.122+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:37:43.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.141+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:37:43.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.146+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:37:43.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.172+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:37:43.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.175+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:37:43.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.175+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:37:43.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.189+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:37:43.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.190+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:37:43.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.203+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:37:43.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.216+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:37:43.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.216+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:37:43.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.263+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:37:43.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.264+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:37:43.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.271+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:37:43.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.277+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:37:43.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.281+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:37:43.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.298+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:37:43.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.309+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:37:43.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.329+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:37:43.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.337+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:37:43.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.337+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:37:43.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.357+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:37:43.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.373+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:37:43.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.374+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:37:43.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.383+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:37:43.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.387+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:37:43.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.397+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:37:43.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.435+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:37:43.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.443+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:37:43.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.461+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:37:43.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.476+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:37:43.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.481+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:37:43.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.509+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:37:43.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.509+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:37:43.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.510+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:37:43.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.511+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:37:43.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.524+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:37:43.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.560+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:37:43.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.582+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:37:43.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.589+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:37:43.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.604+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:37:43.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.609+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:37:43.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.617+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:37:43.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.644+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:37:43.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.646+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:37:43.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.647+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:37:43.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:37:43.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.654+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:37:43.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.694+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:37:43.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.703+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:37:43.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.720+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:37:43.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.721+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:37:43.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.729+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:37:43.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.731+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:37:43.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:37:43.742826+0000 min lat: 0.000227768 max lat: 0.114701 avg lat: 0.00116542 2024-09-17T16:37:43.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:37:43.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 80 15 1088344 1088329 850.182 855.188 0.0212885 0.00116542 2024-09-17T16:37:43.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.746+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:37:43.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.757+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:37:43.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.761+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:37:43.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.798+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:37:43.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.804+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:37:43.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.807+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:37:43.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.812+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:37:43.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.814+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:37:43.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.846+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:37:43.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.863+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:37:43.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.863+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:37:43.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:37:43.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.887+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:37:43.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.895+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:37:43.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.909+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:37:43.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.929+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:37:43.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.932+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:37:43.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.945+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:37:43.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.970+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:37:43.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.975+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:37:43.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.996+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:37:44.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.998+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:37:44.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:43.999+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:37:44.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.010+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:37:44.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.039+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:37:44.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.047+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:37:44.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.068+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:37:44.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.091+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:37:44.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.096+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:37:44.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.109+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:37:44.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.112+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:37:44.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.113+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:37:44.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.144+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:37:44.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.156+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:37:44.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.162+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:37:44.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.173+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:37:44.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.173+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:37:44.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.186+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:37:44.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.193+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:37:44.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.203+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:44.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.227+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:37:44.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.240+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:37:44.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.256+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:37:44.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.261+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:37:44.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.275+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:37:44.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.287+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:37:44.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.293+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:37:44.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.310+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:37:44.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.320+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:37:44.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.330+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:37:44.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:37:44.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.340+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:37:44.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.350+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:37:44.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.366+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:37:44.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.374+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:37:44.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.378+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:37:44.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.400+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:37:44.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.418+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:37:44.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.429+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:37:44.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.430+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:37:44.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.437+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:37:44.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.451+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:37:44.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.464+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:37:44.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.468+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:37:44.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.472+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:37:44.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.474+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:37:44.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.503+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:37:44.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.514+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:37:44.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.517+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:44.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.520+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:37:44.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.525+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:37:44.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.540+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:37:44.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:37:44.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.582+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:37:44.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.582+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:37:44.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.584+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:37:44.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.603+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:37:44.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.611+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:37:44.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.611+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:37:44.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.625+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:37:44.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.636+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:37:44.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.642+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:37:44.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.664+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:37:44.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.672+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:37:44.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.701+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:37:44.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.704+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:37:44.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.704+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:44.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.731+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:37:44.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.733+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:37:44.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.737+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:37:44.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 81 16 1101777 1101761 850.05 839.5 0.000984458 0.00116558 2024-09-17T16:37:44.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.750+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:37:44.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.754+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:37:44.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.762+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:37:44.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.789+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:37:44.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.809+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:37:44.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.810+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:37:44.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.820+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:37:44.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:37:44.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.843+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:37:44.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.848+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:37:44.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.858+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:37:44.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.858+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:37:44.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.873+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:37:44.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.889+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:37:44.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.895+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:37:44.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.896+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:44.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.910+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:37:44.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.916+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:37:44.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.923+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:37:44.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.937+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:37:44.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.955+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:37:44.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.972+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:37:44.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.973+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:37:44.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.976+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:45.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:44.999+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:37:45.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.011+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:37:45.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.019+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:37:45.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.036+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:37:45.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.046+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:37:45.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.054+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:37:45.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:37:45.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.097+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:37:45.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.105+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:37:45.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.113+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:37:45.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.132+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:37:45.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.134+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:37:45.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.137+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:37:45.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.146+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:37:45.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.163+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:37:45.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.166+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:37:45.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.175+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:37:45.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.178+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:37:45.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.202+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:37:45.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.203+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:37:45.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.216+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:37:45.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.236+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:45.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.237+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:37:45.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.256+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:37:45.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.259+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:37:45.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.260+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:37:45.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:37:45.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:37:45.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.281+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:37:45.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.287+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:37:45.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.311+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:37:45.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.321+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:37:45.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:45.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.354+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:37:45.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.363+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:37:45.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.368+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:37:45.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.386+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:37:45.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.400+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:37:45.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.421+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:37:45.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:37:45.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.440+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:37:45.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.440+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:37:45.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.449+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:37:45.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.452+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:37:45.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.466+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:37:45.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:37:45.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.502+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:37:45.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.513+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:37:45.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.535+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:37:45.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.538+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:37:45.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.542+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:37:45.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.545+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:37:45.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.562+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:37:45.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.591+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:37:45.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.591+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:37:45.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.598+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:37:45.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.613+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:37:45.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.617+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:37:45.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.620+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:45.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.637+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:37:45.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.685+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:45.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.687+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:37:45.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.697+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:37:45.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.697+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:37:45.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.707+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:37:45.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.741+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:37:45.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 82 15 1115250 1115235 849.952 842.125 0.000721486 0.00116576 2024-09-17T16:37:45.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.742+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:37:45.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.754+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:37:45.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.775+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:37:45.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.784+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:37:45.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.794+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:37:45.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.809+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:37:45.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.820+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:37:45.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.826+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:37:45.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.849+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:37:45.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.858+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:37:45.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.872+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:37:45.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.872+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:37:45.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.889+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:37:45.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.891+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:37:45.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.909+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:37:45.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.915+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:37:45.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.922+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:37:45.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.931+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:37:45.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:37:45.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.970+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:45.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.978+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:37:45.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.991+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:37:45.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:45.995+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:37:46.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.024+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:37:46.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.048+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:37:46.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.058+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:46.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.064+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:37:46.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.066+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:37:46.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.075+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:37:46.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.088+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:37:46.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.094+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:37:46.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.149+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:46.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.153+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:37:46.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:37:46.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.190+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:37:46.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.210+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:37:46.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.221+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:37:46.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.238+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:37:46.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.247+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:37:46.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.247+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:37:46.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.248+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:37:46.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.263+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:37:46.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.275+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:37:46.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.288+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:37:46.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.307+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:37:46.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.327+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:37:46.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.335+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:37:46.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.343+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:37:46.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.345+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:37:46.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.359+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:37:46.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.367+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:37:46.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.371+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:37:46.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.401+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:37:46.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:37:46.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:37:46.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.439+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:37:46.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.447+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:37:46.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.449+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:37:46.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.452+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:37:46.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.468+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:37:46.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.474+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:37:46.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.487+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:37:46.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.506+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:37:46.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.513+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:37:46.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.526+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:37:46.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.544+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:37:46.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.549+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:37:46.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.565+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:37:46.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.578+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:37:46.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.580+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:37:46.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.591+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:37:46.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.607+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:37:46.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.624+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:37:46.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.634+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:37:46.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.642+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:37:46.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.662+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:37:46.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.671+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:37:46.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.693+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:37:46.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.702+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:37:46.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.712+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:37:46.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.718+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:37:46.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 83 15 1129164 1129149 850.188 869.625 0.000880029 0.00116543 2024-09-17T16:37:46.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.750+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:37:46.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.760+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:37:46.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.765+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:37:46.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.766+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:37:46.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.779+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:37:46.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.786+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:37:46.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.802+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:37:46.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.812+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:37:46.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.830+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:37:46.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.832+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:37:46.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.843+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:37:46.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.858+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:37:46.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.862+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:37:46.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.887+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:46.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.914+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:37:46.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.916+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:37:46.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.944+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:37:46.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.946+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:37:46.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.958+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:37:46.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.963+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:37:46.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.990+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:37:46.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:46.996+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:37:47.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.004+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:37:47.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.010+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:37:47.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.037+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:37:47.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.045+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:37:47.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.047+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:47.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.051+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:37:47.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.066+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:37:47.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.075+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:37:47.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.085+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:37:47.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.091+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:37:47.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.115+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:37:47.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:37:47.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.122+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:37:47.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.123+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:37:47.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.125+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:37:47.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.175+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:37:47.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.186+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:37:47.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.207+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:37:47.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.212+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:37:47.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.222+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:37:47.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.224+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:37:47.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.236+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:37:47.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.240+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:37:47.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.241+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:37:47.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.262+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:37:47.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.271+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:37:47.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.276+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:37:47.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.308+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:37:47.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.319+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:37:47.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.333+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:37:47.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.334+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:37:47.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.335+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:37:47.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.353+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:47.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.381+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:37:47.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.396+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:37:47.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.412+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:37:47.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.420+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:37:47.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.427+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:37:47.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.463+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:37:47.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.473+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:37:47.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.483+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:37:47.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.486+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:37:47.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.494+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:37:47.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.507+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:37:47.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.530+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:37:47.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.538+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:37:47.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.555+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:37:47.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.558+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:37:47.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.559+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:37:47.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.559+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:37:47.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.571+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:37:47.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.591+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:37:47.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.598+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:37:47.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.609+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:47.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.634+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:37:47.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.642+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:37:47.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.643+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:37:47.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.646+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:37:47.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.671+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:37:47.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.686+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:37:47.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.698+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:37:47.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.700+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:47.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.706+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:47.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.712+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:37:47.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.730+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:37:47.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 84 16 1142861 1142845 850.257 856 0.000710519 0.00116526 2024-09-17T16:37:47.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.747+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:37:47.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.750+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:37:47.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.766+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:37:47.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.780+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:37:47.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.789+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:37:47.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.794+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:37:47.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:37:47.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.828+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:37:47.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.841+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:37:47.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.854+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:37:47.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.858+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:37:47.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.884+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:37:47.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.888+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:37:47.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.895+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:37:47.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.919+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:37:47.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.926+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:37:47.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.930+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:37:47.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.947+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:37:47.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.948+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:37:47.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.960+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:37:47.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.964+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:37:47.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.965+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:37:47.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:47.978+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:37:48.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.003+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:37:48.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.010+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:37:48.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.013+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:37:48.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.022+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.044+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.051+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.054+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.068+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.084+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.096+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.102+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.123+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.131+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.131+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.131+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.163+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:37:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.164+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:48.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:37:48.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.200+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:37:48.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:37:48.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.232+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:37:48.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.236+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:37:48.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.236+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:37:48.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.265+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:37:48.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.276+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:37:48.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.280+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:37:48.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.294+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:37:48.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.309+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:37:48.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.313+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:37:48.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.336+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:37:48.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.337+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:37:48.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.349+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:37:48.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.380+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:37:48.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.385+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:37:48.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.396+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:37:48.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.398+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:37:48.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.414+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:37:48.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.417+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:37:48.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.420+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:37:48.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.423+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:37:48.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.450+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:37:48.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.450+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:37:48.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.453+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:48.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.490+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:37:48.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.499+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:37:48.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.510+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:37:48.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.513+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:37:48.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.530+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:37:48.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.531+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:37:48.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.546+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:37:48.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.549+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:37:48.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.558+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:37:48.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.577+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:37:48.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.583+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:37:48.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.594+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:37:48.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.601+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:37:48.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.608+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:37:48.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.627+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:37:48.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.630+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:37:48.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:37:48.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.635+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:37:48.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.658+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:37:48.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.661+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:37:48.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.667+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:37:48.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.693+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:37:48.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.703+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:37:48.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.706+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:37:48.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.735+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:37:48.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.736+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:37:48.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:37:48.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 85 16 1156452 1156436 850.246 849.438 0.000698206 0.00116534 2024-09-17T16:37:48.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.748+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:37:48.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.800+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:37:48.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.802+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:37:48.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.809+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:37:48.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.832+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:37:48.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.839+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:37:48.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.856+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:37:48.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.881+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:37:48.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.884+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:37:48.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.884+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:37:48.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.909+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:37:48.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.925+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:37:48.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.932+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:37:48.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.937+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:37:48.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.953+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:37:48.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.960+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:37:48.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.966+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:48.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.996+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:37:48.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:48.997+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:37:49.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.012+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:37:49.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.024+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:37:49.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.031+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:37:49.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.041+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:37:49.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.053+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:37:49.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.071+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:37:49.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.074+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:37:49.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.090+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:37:49.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.098+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:37:49.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.104+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:37:49.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.156+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:37:49.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.159+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:37:49.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.163+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:37:49.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.164+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:37:49.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.172+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:37:49.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.182+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:37:49.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.194+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:37:49.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.208+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:37:49.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.208+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:37:49.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.222+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:37:49.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.227+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:37:49.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.239+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:37:49.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.251+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:37:49.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.260+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:37:49.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.296+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:37:49.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.299+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:37:49.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.319+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:37:49.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.320+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:37:49.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.333+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:37:49.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.341+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:37:49.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.356+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:37:49.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.362+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:37:49.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.383+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:37:49.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.407+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:37:49.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.419+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:37:49.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.425+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:37:49.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.427+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:37:49.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.432+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:37:49.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.441+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:37:49.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.479+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:37:49.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.483+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:37:49.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.494+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:37:49.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.497+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:37:49.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.533+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:37:49.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.538+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:37:49.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.563+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:37:49.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.571+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:37:49.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.573+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:37:49.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:37:49.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.583+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:37:49.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.593+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:37:49.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.603+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:37:49.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.612+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:37:49.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.627+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:37:49.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.647+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:37:49.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.681+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:37:49.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.690+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:37:49.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.690+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:37:49.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.694+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:37:49.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.711+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:37:49.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.713+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:37:49.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.715+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:37:49.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 86 16 1170346 1170330 850.456 868.375 0.00153298 0.00116503 2024-09-17T16:37:49.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.752+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:37:49.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.781+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:37:49.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.789+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:37:49.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.791+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:37:49.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.805+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:37:49.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.811+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:37:49.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.836+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:37:49.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.843+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:37:49.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.849+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:37:49.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.860+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:37:49.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.865+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:37:49.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.874+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:37:49.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.897+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:37:49.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.897+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:37:49.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.900+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:37:49.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.902+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:37:49.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.924+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:37:49.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.932+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:37:49.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.952+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:37:49.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.955+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:37:49.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.972+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:37:49.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.974+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:37:49.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.987+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:37:49.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:49.989+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:37:50.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.011+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:37:50.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.023+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:37:50.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.028+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:37:50.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.031+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:37:50.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.044+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:37:50.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.067+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:37:50.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.075+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:37:50.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.112+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:37:50.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.114+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:50.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.127+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:37:50.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.128+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:37:50.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.132+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:37:50.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.133+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:37:50.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.154+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:37:50.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.187+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:37:50.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.194+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:37:50.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.194+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:37:50.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.223+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:37:50.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.242+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:37:50.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.246+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:37:50.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.269+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:37:50.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.269+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:37:50.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.272+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:37:50.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.292+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:37:50.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.313+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:37:50.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.314+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:37:50.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.323+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:37:50.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.323+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:37:50.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.341+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:37:50.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.348+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:37:50.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.388+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:37:50.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.391+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:37:50.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.407+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:50.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.417+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:37:50.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.444+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:37:50.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.451+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:37:50.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.461+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:37:50.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.462+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:37:50.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.467+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:37:50.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.477+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:37:50.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.478+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:50.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.507+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:37:50.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.518+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:50.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.524+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:37:50.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.526+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:37:50.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.547+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:37:50.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.561+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:37:50.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.561+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:37:50.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.564+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:50.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.594+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:37:50.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.605+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:37:50.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.618+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:37:50.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.628+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:37:50.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.637+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:37:50.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.651+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:37:50.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.682+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:37:50.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.701+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:37:50.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:37:50.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.709+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:37:50.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.717+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:37:50.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.725+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:37:50.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.731+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:37:50.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.733+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:37:50.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.739+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:37:50.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 87 16 1184225 1184209 850.651 867.438 0.00073385 0.00116474 2024-09-17T16:37:50.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.761+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:37:50.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.772+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:37:50.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.784+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:37:50.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.813+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:50.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.813+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:37:50.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.821+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:37:50.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:37:50.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.854+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:37:50.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.869+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:37:50.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.873+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:37:50.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.880+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:37:50.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.889+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:37:50.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.889+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:37:50.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.902+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:37:50.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.934+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:37:50.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.943+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:37:50.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:37:50.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.946+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:37:50.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.959+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:50.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:50.961+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:37:51.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.012+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:37:51.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.021+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:37:51.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.032+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:37:51.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.044+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:37:51.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.058+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:37:51.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.068+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:37:51.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.075+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:37:51.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.085+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:37:51.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.096+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:37:51.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.103+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:37:51.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.115+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:37:51.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.128+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:37:51.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.129+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:37:51.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.137+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:37:51.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.158+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:37:51.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.169+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:37:51.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.171+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:51.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.184+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:37:51.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.194+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:37:51.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.196+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:37:51.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.198+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:37:51.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.211+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:37:51.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.230+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:37:51.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.261+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:37:51.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.272+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:37:51.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.277+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:37:51.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.288+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:37:51.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.293+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:37:51.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.302+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:37:51.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.306+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:37:51.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.309+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:37:51.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.331+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:37:51.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.339+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:37:51.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.342+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:37:51.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.362+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:37:51.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.363+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:37:51.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.375+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:37:51.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.389+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:37:51.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.389+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:37:51.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.413+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:37:51.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.417+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:37:51.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.424+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:37:51.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.432+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:37:51.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.438+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:37:51.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.450+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:37:51.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.457+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:37:51.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.464+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:37:51.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.486+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:37:51.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.492+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:37:51.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.495+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:37:51.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.541+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:37:51.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.543+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:37:51.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.570+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:37:51.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.578+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:37:51.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.606+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:37:51.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.616+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:37:51.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.632+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:37:51.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.648+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:37:51.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.661+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:37:51.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.664+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:37:51.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:37:51.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.693+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:37:51.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.708+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:37:51.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.708+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:37:51.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:37:51.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 88 15 1197708 1197693 850.56 842.75 0.000555346 0.00116489 2024-09-17T16:37:51.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.744+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:37:51.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.753+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:37:51.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.759+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:37:51.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.767+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:37:51.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.777+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:37:51.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.779+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:37:51.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.779+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:37:51.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.818+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:37:51.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.818+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:37:51.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.823+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:37:51.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.842+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:37:51.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.845+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:37:51.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.855+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:37:51.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.856+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:37:51.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.888+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:37:51.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.896+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:37:51.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.913+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:37:51.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.914+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:37:51.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.918+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:37:51.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.940+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:37:51.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.947+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:37:51.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.957+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:51.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.966+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:37:51.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.966+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:51.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.996+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:37:52.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:51.999+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:37:52.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.030+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:37:52.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.044+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:52.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.060+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:37:52.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.061+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:37:52.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.061+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:37:52.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:52.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.088+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:37:52.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.111+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:37:52.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.115+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:37:52.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.126+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:37:52.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:37:52.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.138+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:37:52.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.141+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:37:52.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.150+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:37:52.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.158+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:37:52.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.171+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:37:52.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.193+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:37:52.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.198+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:37:52.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.210+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:37:52.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.226+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:37:52.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.233+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:37:52.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.260+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:37:52.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.271+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:37:52.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.272+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:37:52.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.276+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:37:52.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.294+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:37:52.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.303+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:52.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.309+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:52.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.329+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:37:52.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.351+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:37:52.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.351+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:37:52.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.352+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:37:52.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.368+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:37:52.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.373+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:37:52.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.401+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:37:52.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.412+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:37:52.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.420+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:37:52.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.445+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:37:52.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.464+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:37:52.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.478+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:52.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.482+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:37:52.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.489+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:37:52.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.497+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:37:52.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.517+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:37:52.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.518+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:37:52.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.525+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:37:52.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.540+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:37:52.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.563+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:37:52.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.581+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:37:52.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.627+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:37:52.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.632+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:37:52.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.637+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:37:52.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.650+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:37:52.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.658+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:37:52.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.660+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:37:52.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:37:52.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.672+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:37:52.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.679+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:37:52.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.692+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:37:52.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.715+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:37:52.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.716+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:37:52.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.722+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:37:52.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.730+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:37:52.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 89 16 1211521 1211505 850.702 863.25 0.000515944 0.00116464 2024-09-17T16:37:52.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.746+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:37:52.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.764+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:37:52.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.779+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:37:52.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.800+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:37:52.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.805+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:37:52.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.824+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:37:52.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.830+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:37:52.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.841+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:37:52.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.850+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:37:52.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.855+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:37:52.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.864+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:37:52.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.865+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:37:52.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.900+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:37:52.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.907+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:37:52.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.919+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:37:52.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.933+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:37:52.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.940+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:37:52.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.957+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:37:52.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.966+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:37:52.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.968+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:37:52.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.989+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:37:52.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:52.992+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:37:53.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.009+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:37:53.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.010+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:37:53.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.011+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:37:53.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.013+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:37:53.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.025+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:37:53.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.027+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:37:53.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.043+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:37:53.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.058+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:37:53.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.074+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:37:53.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.083+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:37:53.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.093+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:37:53.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.108+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:37:53.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.116+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:37:53.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.118+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:37:53.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.146+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:37:53.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.156+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:37:53.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.175+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:37:53.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.176+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:37:53.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.184+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:37:53.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.210+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:37:53.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.211+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:37:53.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.224+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:37:53.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.248+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:37:53.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.260+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:37:53.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.283+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:37:53.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.292+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:37:53.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.303+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:37:53.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.305+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:37:53.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.318+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:37:53.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.328+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:53.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.340+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:37:53.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.347+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:37:53.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.356+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:53.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.371+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:37:53.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.383+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:37:53.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.397+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:37:53.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.409+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:37:53.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.420+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:37:53.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.421+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:37:53.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.422+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:37:53.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.428+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:37:53.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.457+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:37:53.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.471+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:37:53.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.477+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:37:53.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.492+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:37:53.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.494+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:37:53.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.517+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:37:53.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.522+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:37:53.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.525+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:37:53.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:37:53.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.562+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:37:53.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.581+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:37:53.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.583+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:37:53.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.583+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:37:53.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.599+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:37:53.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.618+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:37:53.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.618+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:37:53.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.657+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:37:53.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.666+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:37:53.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.681+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:37:53.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.692+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:37:53.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.716+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:37:53.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.721+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:37:53.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.722+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:37:53.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.734+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:37:53.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 90 16 1225382 1225366 850.875 866.312 0.000845396 0.00116445 2024-09-17T16:37:53.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.743+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:37:53.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.759+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:37:53.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.762+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:37:53.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.777+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:37:53.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.778+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:37:53.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.786+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:37:53.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.790+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:37:53.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.802+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:37:53.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.837+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:37:53.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.852+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:37:53.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.863+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:37:53.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.864+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:53.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.881+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:37:53.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.882+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:37:53.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.901+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:37:53.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.901+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:37:53.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.905+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:53.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:37:53.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.956+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:37:53.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.979+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:37:53.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:53.988+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:37:54.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.000+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:37:54.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.019+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:37:54.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.020+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:37:54.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.030+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:37:54.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.073+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:37:54.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.083+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:37:54.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.086+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:54.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.091+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:37:54.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.114+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:37:54.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:37:54.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.142+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:37:54.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:37:54.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:37:54.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.195+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:37:54.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.200+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:37:54.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.201+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:37:54.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.247+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:37:54.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.261+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:37:54.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.273+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:37:54.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.276+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:37:54.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.276+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:37:54.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:37:54.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.292+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:37:54.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.315+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:37:54.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.319+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:37:54.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.321+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:37:54.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.332+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:37:54.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.340+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:37:54.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.355+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:37:54.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.377+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:37:54.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.383+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:37:54.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.390+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:37:54.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:37:54.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.432+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:37:54.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.439+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:37:54.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.458+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:37:54.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.473+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:37:54.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.481+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:37:54.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.510+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:37:54.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.520+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:37:54.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.526+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:37:54.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.549+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:37:54.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.551+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:37:54.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.557+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:37:54.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.572+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:37:54.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.573+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:37:54.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.593+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:37:54.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.606+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:37:54.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.616+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:37:54.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.619+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:37:54.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:37:54.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.658+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:37:54.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.660+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:37:54.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.675+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:37:54.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.686+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:37:54.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.704+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:37:54.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.714+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:37:54.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:54.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.734+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:54.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.742+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:37:54.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 91 16 1239623 1239607 851.305 890.062 0.00114624 0.00116387 2024-09-17T16:37:54.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.758+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:37:54.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.759+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:37:54.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.764+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:54.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.787+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:37:54.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.791+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:37:54.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.826+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:37:54.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.826+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:37:54.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.852+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:37:54.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.859+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:37:54.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.860+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:37:54.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.881+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:37:54.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.903+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:37:54.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.904+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:37:54.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.919+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:37:54.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.927+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:37:54.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.929+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:37:54.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.933+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:37:54.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.946+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:37:54.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.950+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:37:54.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.958+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:37:54.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.958+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:37:54.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:54.980+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:37:55.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.001+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:37:55.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:37:55.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.017+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:37:55.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.024+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:37:55.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.040+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:37:55.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.050+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:37:55.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.052+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:37:55.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.068+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:37:55.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.073+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:37:55.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.079+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:37:55.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.091+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:37:55.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.102+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:37:55.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.124+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:37:55.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:37:55.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.137+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:37:55.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.139+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:37:55.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:37:55.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.175+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:37:55.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.176+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:37:55.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.182+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:37:55.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.201+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:37:55.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.208+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:37:55.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.223+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:37:55.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.231+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:37:55.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.268+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:37:55.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.271+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:37:55.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:37:55.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.289+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:37:55.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.315+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:55.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:37:55.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.332+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:37:55.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.342+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:37:55.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.347+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:37:55.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.355+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:37:55.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.365+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:37:55.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.370+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:37:55.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.379+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:37:55.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.388+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:37:55.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.399+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:37:55.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.407+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:37:55.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.422+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:37:55.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.440+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:37:55.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.440+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:37:55.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.454+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:37:55.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.458+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:37:55.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.460+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:37:55.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.483+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:37:55.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.499+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:37:55.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.500+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:37:55.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.507+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:37:55.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.507+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:37:55.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.533+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:37:55.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.541+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:37:55.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.558+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:37:55.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.559+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:37:55.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.583+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:37:55.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.604+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:37:55.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.607+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:37:55.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.629+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:37:55.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.635+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:37:55.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:37:55.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.643+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:37:55.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.650+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:37:55.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.674+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:37:55.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.679+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:37:55.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.689+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:37:55.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.727+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:37:55.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.728+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:37:55.744 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 92 16 1253028 1253012 851.157 837.812 0.000965244 0.00116407 2024-09-17T16:37:55.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.751+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:37:55.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.771+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:37:55.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.776+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:37:55.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.811+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:37:55.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.817+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:37:55.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.821+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:37:55.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.848+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:37:55.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.854+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:37:55.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.858+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:37:55.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.893+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:37:55.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.906+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:37:55.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.918+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:37:55.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.919+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:37:55.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.927+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:37:55.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.937+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:37:55.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.946+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:37:55.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.949+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:37:55.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.961+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:37:55.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:55.972+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:56.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:37:56.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.012+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:37:56.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.014+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:37:56.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.020+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:37:56.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.022+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:37:56.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.026+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:56.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.043+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:37:56.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.046+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:37:56.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.089+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:37:56.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.091+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:37:56.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.093+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:37:56.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.116+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:37:56.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.121+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:37:56.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.137+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:37:56.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.157+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:37:56.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:37:56.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.172+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:37:56.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.192+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:37:56.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.195+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:37:56.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.210+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:37:56.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.211+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:37:56.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.225+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:37:56.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.237+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:37:56.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.244+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:37:56.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.269+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:37:56.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.270+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:37:56.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.280+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:37:56.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.293+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:37:56.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.295+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:37:56.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.302+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:37:56.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.311+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:37:56.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.312+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:37:56.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.324+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:37:56.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.334+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:37:56.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.357+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:37:56.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.360+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:37:56.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.383+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:37:56.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.385+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:37:56.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.387+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:37:56.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.406+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:37:56.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.430+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:37:56.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.432+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:37:56.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.435+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:37:56.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:37:56.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.458+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:37:56.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.467+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:37:56.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.484+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:37:56.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.501+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:37:56.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.505+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:37:56.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.505+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:37:56.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.506+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:37:56.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.513+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:37:56.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.522+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:37:56.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.539+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:37:56.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.548+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:37:56.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.566+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:37:56.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.567+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:37:56.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.571+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:37:56.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.593+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:37:56.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.596+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:37:56.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.598+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:37:56.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.604+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:37:56.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.620+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:37:56.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.637+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:37:56.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.658+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:37:56.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.685+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:37:56.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.686+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:37:56.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.687+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:37:56.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.698+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:37:56.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.707+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:37:56.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.725+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:37:56.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.726+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:37:56.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 93 16 1266600 1266584 851.124 848.25 0.00071019 0.00116412 2024-09-17T16:37:56.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.746+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:37:56.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.752+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:37:56.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.767+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:37:56.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.776+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:37:56.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.797+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:37:56.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.797+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:37:56.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.798+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:37:56.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.803+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:37:56.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:37:56.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.809+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:37:56.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.831+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:37:56.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.853+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:37:56.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.857+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:37:56.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.898+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:37:56.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.905+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:37:56.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.921+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:37:56.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.929+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:37:56.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.938+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:37:56.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.946+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:37:56.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.947+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:37:56.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:56.995+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:37:57.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.006+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:37:57.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.009+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:37:57.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.014+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:37:57.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.032+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:37:57.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.069+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:37:57.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.073+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:37:57.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.087+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:37:57.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.100+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:37:57.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.122+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:37:57.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.132+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:37:57.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.133+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:37:57.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.145+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:37:57.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.160+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:37:57.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.171+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:37:57.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.176+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:37:57.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.199+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:37:57.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.208+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:37:57.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.225+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:37:57.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.228+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:37:57.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.238+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:37:57.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.252+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:37:57.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.271+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:37:57.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.273+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:37:57.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.273+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:37:57.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.288+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:37:57.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.292+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:37:57.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.309+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:37:57.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.313+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:37:57.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.320+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:37:57.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.323+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:37:57.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.326+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:37:57.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:37:57.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.364+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:37:57.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.369+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:37:57.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.374+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:37:57.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.390+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:37:57.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:37:57.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.441+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:37:57.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.444+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:37:57.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.467+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:57.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.477+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:37:57.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.501+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:37:57.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.521+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:37:57.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.527+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:37:57.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.528+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:37:57.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.534+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:37:57.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.547+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:37:57.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.559+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:37:57.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.579+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:37:57.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.589+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:37:57.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.591+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:37:57.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.598+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:37:57.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.608+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:57.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.628+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:37:57.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.631+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:37:57.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.638+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:37:57.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.655+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:37:57.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.657+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:37:57.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.664+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:37:57.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.679+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:37:57.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.704+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:37:57.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.721+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:37:57.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:37:57.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 94 16 1280648 1280632 851.41 878 0.00066855 0.00116374 2024-09-17T16:37:57.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.752+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:37:57.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.755+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:37:57.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.777+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:37:57.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.782+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:37:57.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.784+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:37:57.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.812+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:37:57.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.826+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:57.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.840+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:37:57.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.843+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:37:57.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.843+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:37:57.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.864+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:37:57.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.879+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:37:57.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.882+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:37:57.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.900+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:37:57.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.907+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:37:57.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.913+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:37:57.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.935+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:37:57.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.944+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:37:57.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:37:57.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.976+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:37:57.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.986+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:37:57.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:57.993+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:37:58.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.003+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:37:58.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.006+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:37:58.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.019+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:37:58.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.023+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:37:58.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.045+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:37:58.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.054+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:37:58.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.059+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:37:58.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.080+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:37:58.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:37:58.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.098+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:37:58.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.127+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:37:58.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.131+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:58.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.152+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:37:58.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.154+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:37:58.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.162+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:37:58.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.178+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:37:58.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.179+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:37:58.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.204+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:37:58.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.221+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:37:58.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.237+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:37:58.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.245+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:37:58.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.267+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:37:58.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.271+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:37:58.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.275+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:37:58.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.275+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:37:58.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.285+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:37:58.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.287+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:37:58.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.331+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:37:58.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.338+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:37:58.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.347+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:37:58.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.356+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:37:58.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.357+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:37:58.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.370+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:37:58.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.390+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:37:58.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.390+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:37:58.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.410+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:37:58.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.420+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:37:58.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:37:58.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.443+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:37:58.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.458+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:37:58.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.474+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:37:58.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.476+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:37:58.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.481+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:37:58.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.514+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:37:58.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.545+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:37:58.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.549+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:37:58.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.550+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:37:58.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.555+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:37:58.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.587+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:37:58.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.604+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:37:58.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.610+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:37:58.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.617+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:37:58.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.626+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:37:58.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.646+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:37:58.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:37:58.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.661+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:37:58.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.691+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:37:58.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.692+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:37:58.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.710+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:37:58.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:37:58.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.722+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:37:58.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.739+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:37:58.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 95 16 1294619 1294603 851.638 873.188 0.0034809 0.00116339 2024-09-17T16:37:58.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.752+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:37:58.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.767+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:37:58.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.779+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:37:58.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.783+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:37:58.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.793+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:37:58.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.795+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:37:58.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.814+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:37:58.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.824+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:37:58.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.839+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:37:58.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.856+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:37:58.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.865+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:37:58.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.882+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:37:58.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:37:58.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.907+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:37:58.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.912+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:37:58.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.923+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:37:58.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.924+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:37:58.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:37:58.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.947+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:37:58.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.970+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:37:58.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:58.995+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:37:59.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.005+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:37:59.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.008+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:37:59.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.029+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:37:59.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.035+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:37:59.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.037+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:37:59.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.063+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:37:59.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.078+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:37:59.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.081+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:37:59.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.093+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:37:59.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.098+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:37:59.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:37:59.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.121+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:37:59.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.137+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:37:59.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.137+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:37:59.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.161+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:37:59.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.162+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:37:59.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.202+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:37:59.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:37:59.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.218+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:37:59.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.223+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:37:59.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.228+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:37:59.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.242+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:37:59.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.259+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:37:59.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.267+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:37:59.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.292+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:37:59.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.303+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:37:59.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.320+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:37:59.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.322+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:37:59.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.341+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:37:59.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:37:59.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.358+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:37:59.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.405+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:37:59.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.405+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:37:59.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.429+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:37:59.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.442+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:37:59.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.452+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:37:59.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.463+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:37:59.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.472+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:37:59.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.472+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:37:59.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.485+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:37:59.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.486+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:37:59.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.511+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:37:59.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.518+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:37:59.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.528+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:37:59.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.539+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:37:59.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.545+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:37:59.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.559+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:37:59.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:37:59.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.598+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:37:59.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.620+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:37:59.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.621+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:37:59.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.626+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:37:59.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.646+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:37:59.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.667+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:37:59.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.670+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:37:59.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.677+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:37:59.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.691+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:37:59.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.705+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:37:59.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.727+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:37:59.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.732+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:37:59.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.736+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:37:59.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 96 16 1308424 1308408 851.754 862.812 0.000719102 0.00116325 2024-09-17T16:37:59.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.757+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:37:59.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.761+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:37:59.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.764+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:37:59.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.771+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:37:59.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.800+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:37:59.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.805+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:37:59.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.813+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:37:59.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.815+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:37:59.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.826+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:37:59.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.826+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:37:59.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.847+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:37:59.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.848+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:37:59.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.880+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:37:59.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.889+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:37:59.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.891+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:37:59.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.911+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:37:59.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.919+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:37:59.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.933+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:37:59.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.934+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:37:59.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.934+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:37:59.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.951+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:37:59.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.972+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:37:59.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.992+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:37:59.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:37:59.994+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:38:00.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.009+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:00.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.028+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:38:00.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.047+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:38:00.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.050+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:00.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.054+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:38:00.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.068+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:38:00.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.074+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:38:00.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.082+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:38:00.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.097+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:38:00.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.109+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:38:00.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.119+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:38:00.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.124+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:38:00.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.124+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:38:00.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.256+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:38:00.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.264+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:38:00.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.269+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:38:00.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.287+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:38:00.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.292+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:38:00.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.319+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:38:00.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.319+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:38:00.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.336+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:38:00.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.343+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:00.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.364+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:38:00.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.369+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:38:00.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.369+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:38:00.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.387+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:38:00.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.392+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:38:00.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.394+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:38:00.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.414+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:38:00.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.420+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:38:00.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.437+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:38:00.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.465+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:38:00.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.468+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:38:00.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.479+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:38:00.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.485+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:00.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.518+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:38:00.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.524+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:38:00.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.535+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:38:00.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.546+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:38:00.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.549+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:38:00.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.556+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:38:00.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.558+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:38:00.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.588+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:38:00.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.598+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:38:00.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.603+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:38:00.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.614+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:38:00.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.625+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:38:00.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.627+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:38:00.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.643+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:38:00.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:38:00.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.674+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:38:00.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.691+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:38:00.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.699+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:00.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.710+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:38:00.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.726+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:38:00.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.729+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:38:00.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.738+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:38:00.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.742+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:38:00.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 97 16 1320851 1320835 850.979 776.688 0.00071725 0.00116432 2024-09-17T16:38:00.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.744+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:00.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.761+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:38:00.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.786+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:38:00.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.787+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:38:00.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.811+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:38:00.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.812+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:38:00.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.821+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:38:00.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.833+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:38:00.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.838+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:00.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.852+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:38:00.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.866+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:38:00.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.879+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:38:00.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.893+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:38:00.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.901+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:38:00.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.907+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:38:00.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.931+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:38:00.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.946+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:38:00.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.965+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:38:00.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.967+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:38:00.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.972+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:38:00.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.981+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:38:00.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:00.989+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:38:01.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.002+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:38:01.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.013+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:38:01.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.023+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:38:01.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.031+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:38:01.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.038+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:38:01.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.065+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:38:01.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.067+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:38:01.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.072+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:38:01.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.076+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:38:01.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.081+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:38:01.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.082+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:38:01.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.111+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:38:01.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.111+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:38:01.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.113+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:38:01.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.122+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:38:01.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.134+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:38:01.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.162+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:38:01.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.170+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:38:01.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.174+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:38:01.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.209+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:38:01.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.224+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:38:01.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.229+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:38:01.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.236+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:38:01.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.238+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:38:01.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.242+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:38:01.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.254+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:38:01.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.267+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:38:01.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.287+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:38:01.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.287+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:38:01.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.291+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:38:01.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.323+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:38:01.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.354+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:38:01.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.370+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:38:01.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.382+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:38:01.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.391+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:38:01.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.395+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:01.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.398+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:38:01.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:38:01.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.403+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:38:01.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.419+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:38:01.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.473+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:38:01.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.478+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:38:01.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.491+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:38:01.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.493+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:38:01.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.494+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:38:01.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.497+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:38:01.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.517+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:38:01.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.527+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:38:01.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.531+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:38:01.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.551+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:38:01.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.554+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:38:01.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.570+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:38:01.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.580+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:38:01.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.585+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:38:01.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.621+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:38:01.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.629+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:38:01.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.638+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:38:01.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.648+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:38:01.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.660+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:38:01.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:38:01.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.675+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:38:01.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.678+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:38:01.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.690+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:38:01.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.700+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:38:01.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.738+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:01.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.742+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:38:01.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 98 16 1333974 1333958 850.664 820.188 0.000817964 0.00116477 2024-09-17T16:38:01.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.764+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:38:01.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.771+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:38:01.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.786+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:38:01.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.789+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:38:01.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.796+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:38:01.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.803+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:38:01.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.811+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:38:01.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.817+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:38:01.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.834+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:38:01.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.844+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:38:01.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.860+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:38:01.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.871+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:38:01.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.874+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:38:01.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.879+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:38:01.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.885+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:38:01.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.892+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:38:01.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.913+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:38:01.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.917+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:38:01.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.930+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:38:01.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.938+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:38:01.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.950+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:38:01.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.959+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:38:01.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:01.988+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:38:02.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.000+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:38:02.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.003+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:38:02.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.004+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:38:02.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:38:02.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.040+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:38:02.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.062+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:38:02.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.066+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:02.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.071+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:38:02.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.080+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:38:02.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.097+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:38:02.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.109+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:38:02.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.120+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:38:02.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.121+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:38:02.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.156+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:38:02.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.161+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:38:02.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.173+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:38:02.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.178+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:38:02.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.189+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:38:02.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.190+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:38:02.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.210+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:38:02.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.211+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:38:02.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.236+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:38:02.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.254+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:38:02.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.265+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:38:02.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.271+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:38:02.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.301+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:02.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.309+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:38:02.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.310+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:38:02.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.347+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:38:02.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.357+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:38:02.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.368+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:38:02.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.380+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:38:02.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.392+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:38:02.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.423+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:38:02.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.425+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:38:02.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.426+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:38:02.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.439+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:38:02.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.450+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:02.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.460+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:38:02.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.463+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:38:02.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.471+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:38:02.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.500+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:38:02.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.510+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:38:02.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.518+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:38:02.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.525+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:38:02.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.528+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:38:02.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.533+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:38:02.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.555+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:02.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.565+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:38:02.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.571+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:38:02.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.582+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:38:02.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.600+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:38:02.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:38:02.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.614+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:38:02.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.618+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:38:02.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.640+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:38:02.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.647+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:38:02.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.660+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:38:02.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.662+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:02.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.674+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:38:02.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.688+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:38:02.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.704+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:02.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:38:02.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.719+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:38:02.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.733+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:38:02.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.739+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:38:02.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 99 16 1347451 1347435 850.579 842.312 0.000340908 0.00116486 2024-09-17T16:38:02.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.745+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:38:02.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.748+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:38:02.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.772+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:38:02.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.787+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:38:02.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.796+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:38:02.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.800+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:38:02.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.809+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:38:02.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.842+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:38:02.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.867+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:38:02.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.882+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:38:02.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.901+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:38:02.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.902+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:38:02.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.916+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:38:02.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.925+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:38:02.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.927+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:38:02.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.940+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:38:02.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.980+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:38:02.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.981+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:38:02.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:02.982+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:38:03.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.008+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:38:03.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.018+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:38:03.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.021+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:38:03.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.043+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:38:03.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.064+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:38:03.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.066+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:38:03.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.076+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:38:03.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.079+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:38:03.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.103+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:38:03.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.108+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:38:03.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.139+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:38:03.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.139+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:38:03.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.141+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:38:03.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.166+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:38:03.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.169+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:38:03.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.176+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:38:03.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.176+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:38:03.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.205+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:38:03.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.208+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:38:03.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.226+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:38:03.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.231+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:38:03.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.244+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:38:03.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.246+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:38:03.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.258+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:38:03.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.267+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:38:03.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.280+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:38:03.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:38:03.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.288+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:38:03.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.292+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:38:03.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.303+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:38:03.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.312+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:38:03.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.331+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:38:03.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.343+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:38:03.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.347+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:38:03.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:38:03.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.363+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:38:03.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.383+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:38:03.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.388+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:38:03.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.399+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:38:03.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.418+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:38:03.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.425+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:38:03.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:38:03.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:38:03.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.464+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:38:03.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.470+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:38:03.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.497+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:38:03.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.507+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:38:03.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.526+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:38:03.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.529+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:38:03.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.549+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:38:03.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.552+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:38:03.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.585+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:03.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.588+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:38:03.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.602+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:38:03.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.622+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:38:03.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.652+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:03.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.654+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:38:03.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.655+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:38:03.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.665+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:38:03.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.685+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:38:03.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.695+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:38:03.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.700+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:38:03.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.734+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:38:03.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.741+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:38:03.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:38:03.744520+0000 min lat: 0.000227768 max lat: 0.114701 avg lat: 0.00116468 2024-09-17T16:38:03.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:38:03.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 100 16 1361298 1361282 850.727 865.438 0.000830527 0.00116468 2024-09-17T16:38:03.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.758+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:38:03.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.770+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:38:03.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.775+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:38:03.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.785+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:03.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.789+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:38:03.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.821+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:38:03.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.835+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:38:03.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.835+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:38:03.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.857+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:38:03.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.865+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:38:03.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.870+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:38:03.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:38:03.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.892+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:38:03.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.902+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:38:03.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.906+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:38:03.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.933+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:38:03.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.934+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:38:03.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.937+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:38:03.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.955+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:38:03.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.965+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:38:03.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.988+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:38:03.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.996+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:38:04.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:03.998+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:38:04.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.022+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:38:04.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.053+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:38:04.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.053+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:38:04.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.055+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:38:04.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.062+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:38:04.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.097+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:04.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.098+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:38:04.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.100+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:38:04.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.106+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:38:04.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.116+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:38:04.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.125+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:38:04.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.152+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:38:04.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.153+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:38:04.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.161+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:38:04.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.166+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:38:04.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.177+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:38:04.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.177+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:38:04.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.185+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:04.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.194+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:38:04.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.203+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:38:04.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.217+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:38:04.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.224+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:04.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.234+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:38:04.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.242+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:38:04.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.272+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:38:04.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.284+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:38:04.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.291+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:38:04.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.293+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:38:04.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.301+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:38:04.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.306+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:38:04.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.309+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:38:04.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.316+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:04.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.334+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:38:04.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.342+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:38:04.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.355+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:04.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.364+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:38:04.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.368+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:38:04.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.382+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:38:04.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.396+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:38:04.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.396+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:04.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.423+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:38:04.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.436+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:04.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.439+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:38:04.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.448+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:04.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.452+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:38:04.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.471+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:38:04.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.484+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:38:04.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.490+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:38:04.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.500+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:38:04.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.511+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:38:04.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.512+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:38:04.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.539+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:38:04.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.547+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:38:04.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.552+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:38:04.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.567+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:38:04.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.579+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:38:04.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.582+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:38:04.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.588+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:38:04.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.590+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:38:04.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.601+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:38:04.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.613+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:38:04.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.618+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:38:04.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.646+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:38:04.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.659+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:38:04.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.667+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:38:04.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.678+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:38:04.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.695+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:38:04.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.703+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:38:04.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.713+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:38:04.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 101 16 1374636 1374620 850.557 833.625 0.000864872 0.00116493 2024-09-17T16:38:04.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:38:04.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.755+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:04.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.776+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:38:04.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.778+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:38:04.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.782+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:38:04.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.788+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:38:04.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.837+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:38:04.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.845+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:38:04.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.856+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:38:04.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.860+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:38:04.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.860+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:38:04.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.887+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:38:04.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.901+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:38:04.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.914+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:38:04.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.917+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:04.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.930+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:38:04.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.934+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:38:04.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.940+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:38:04.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.952+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:38:04.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.970+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:38:04.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.972+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:38:04.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.977+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:38:04.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.986+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:38:04.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.994+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:38:05.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:04.999+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:38:05.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.019+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:38:05.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.024+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:38:05.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:38:05.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.052+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:38:05.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.059+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:38:05.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.060+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:38:05.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.066+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:38:05.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.090+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:38:05.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.095+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:38:05.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.128+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:38:05.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.134+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:05.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.137+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:38:05.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.149+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:38:05.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.157+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:38:05.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.181+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:38:05.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.196+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:05.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.197+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:38:05.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.199+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:38:05.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.225+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:38:05.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.239+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:05.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.261+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:38:05.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:38:05.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.284+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:38:05.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.307+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:38:05.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.307+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:38:05.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.310+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:38:05.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.317+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:38:05.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.326+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:38:05.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.334+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:38:05.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.372+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:38:05.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.388+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:38:05.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.394+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:38:05.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.399+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:38:05.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.431+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:38:05.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.436+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:05.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.437+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:38:05.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.451+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:38:05.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.459+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:38:05.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.466+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:38:05.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.466+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:38:05.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.473+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:05.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:38:05.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.496+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:38:05.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:38:05.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:38:05.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.553+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:38:05.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.561+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:05.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.570+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:05.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.574+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:38:05.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:38:05.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.593+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:38:05.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.604+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:38:05.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.604+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:38:05.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.623+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:38:05.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.643+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:38:05.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.648+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:38:05.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.676+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:38:05.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.677+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:38:05.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.681+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:38:05.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.684+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:38:05.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.716+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:38:05.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.727+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:38:05.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.734+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:38:05.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.740+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:38:05.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 102 16 1388299 1388283 850.59 853.938 0.0175862 0.00116487 2024-09-17T16:38:05.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.768+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:05.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.785+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:38:05.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.817+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:38:05.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:38:05.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.850+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:38:05.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.864+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:38:05.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.866+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:38:05.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.885+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:38:05.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.900+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:38:05.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.906+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:38:05.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.920+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:38:05.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.935+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:38:05.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.937+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:38:05.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.946+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:38:05.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.954+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:38:05.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.964+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:05.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.978+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:38:05.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:05.986+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:38:06.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.005+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:38:06.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.010+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:38:06.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.019+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:38:06.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.037+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:38:06.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.054+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:38:06.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.064+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:38:06.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.070+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:38:06.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.082+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:38:06.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.088+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:38:06.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.092+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:38:06.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.117+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:38:06.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.130+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:38:06.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.131+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:38:06.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.139+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:38:06.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.147+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:38:06.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.149+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:38:06.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.170+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:38:06.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.172+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:38:06.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.235+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:38:06.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.242+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:38:06.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.255+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:38:06.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.267+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:38:06.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.274+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:06.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.290+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:38:06.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.297+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:38:06.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.309+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:38:06.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.327+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:38:06.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.335+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:38:06.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.351+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:38:06.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.368+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:38:06.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.372+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:38:06.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.373+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:06.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.377+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:38:06.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.388+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:38:06.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.404+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:38:06.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.408+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:38:06.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.413+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:38:06.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.416+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:38:06.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.424+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:38:06.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.429+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:38:06.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.442+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:38:06.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.481+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:38:06.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.481+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:06.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.484+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:38:06.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.488+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:38:06.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.519+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:38:06.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.538+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:38:06.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.544+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:38:06.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.553+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:38:06.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.573+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:38:06.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.587+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:38:06.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.601+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:06.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.609+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:38:06.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.631+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:38:06.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.638+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:38:06.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.642+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:06.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.643+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:38:06.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.659+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:38:06.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.685+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:38:06.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.722+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:38:06.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.739+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:38:06.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.742+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:38:06.745 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 103 16 1401488 1401472 850.334 824.312 0.000605125 0.00116523 2024-09-17T16:38:06.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.765+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:38:06.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.769+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:38:06.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.779+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:06.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.799+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:38:06.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.830+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:06.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.831+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:38:06.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.840+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:38:06.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.852+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:38:06.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.864+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:38:06.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.864+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:38:06.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.865+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:38:06.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.912+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:38:06.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.921+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:38:06.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.940+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:38:06.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.943+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:38:06.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.965+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:38:06.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.981+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:38:06.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.989+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:38:06.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:06.993+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:38:07.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.008+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:38:07.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.033+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:38:07.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:38:07.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.042+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:38:07.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.054+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:38:07.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.060+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:38:07.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.068+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:38:07.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.068+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:38:07.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.100+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:38:07.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.101+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:38:07.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.121+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:38:07.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:38:07.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.156+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:07.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.161+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:38:07.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.176+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:38:07.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.198+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:38:07.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.203+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:07.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.208+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:38:07.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.208+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:38:07.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.234+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:38:07.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.257+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:38:07.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.258+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:38:07.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.264+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:38:07.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.267+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:38:07.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.282+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:38:07.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.308+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:38:07.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.308+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:07.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.308+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:38:07.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.314+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:38:07.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:38:07.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.346+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:38:07.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:38:07.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.356+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:38:07.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.371+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:07.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.373+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:38:07.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.401+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:38:07.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.410+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:38:07.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.432+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:38:07.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.438+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:38:07.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.450+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:38:07.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.459+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:38:07.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.461+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:38:07.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.475+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:38:07.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.489+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:07.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.511+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:38:07.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.514+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:38:07.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.530+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:38:07.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.543+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:38:07.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.546+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:38:07.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.562+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:38:07.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.573+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:38:07.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.582+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:38:07.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.606+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:38:07.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.616+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:38:07.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.617+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:38:07.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.637+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:38:07.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.640+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:38:07.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.656+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:38:07.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.689+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:38:07.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.694+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:38:07.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.702+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:38:07.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.703+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:38:07.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.731+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:38:07.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.738+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:38:07.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.741+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:38:07.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.742+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:38:07.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.743+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:38:07.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 104 16 1415223 1415207 850.411 858.438 0.00103901 0.00116512 2024-09-17T16:38:07.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.790+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:38:07.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.800+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:38:07.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.812+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:38:07.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.825+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:38:07.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.827+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:38:07.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.828+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:38:07.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.836+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:38:07.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.850+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:38:07.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.866+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:38:07.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.870+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:38:07.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.886+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:07.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.899+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:38:07.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.907+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:38:07.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.919+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:38:07.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.924+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:38:07.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.933+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:07.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.950+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:38:07.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.972+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:07.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:07.996+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:38:08.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.014+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:38:08.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.015+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:38:08.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.030+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:38:08.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.046+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:38:08.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.049+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:38:08.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.076+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:38:08.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.082+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:38:08.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.083+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:38:08.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.090+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:38:08.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.092+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:38:08.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.112+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:38:08.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.134+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:38:08.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.149+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:38:08.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.159+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:38:08.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.166+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:38:08.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.179+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:38:08.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.188+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:38:08.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.189+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:38:08.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:38:08.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.236+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:38:08.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.239+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:38:08.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.243+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:38:08.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.254+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:08.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.271+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:38:08.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.273+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:38:08.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.278+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:08.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.296+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:38:08.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.319+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:38:08.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.332+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:38:08.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.345+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:38:08.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.353+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:38:08.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.364+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:38:08.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.389+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:38:08.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.397+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:38:08.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.414+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:38:08.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:38:08.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:38:08.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.433+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:38:08.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.440+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:38:08.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:38:08.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.454+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:08.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.475+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:08.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.482+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:38:08.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.494+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:38:08.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.509+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:38:08.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.511+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:38:08.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.530+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:38:08.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.541+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:38:08.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.563+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:08.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.568+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:38:08.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:38:08.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.606+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:38:08.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.608+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:08.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.608+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:38:08.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:38:08.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.631+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:08.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.633+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:38:08.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.638+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:38:08.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.653+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:08.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.661+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:38:08.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.679+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:38:08.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.695+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:38:08.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:38:08.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.721+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:38:08.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 105 16 1428887 1428871 850.444 854 0.000869779 0.00116509 2024-09-17T16:38:08.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.760+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:38:08.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.768+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:38:08.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.776+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:38:08.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.790+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:08.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.793+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:38:08.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.808+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:38:08.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:38:08.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.837+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:38:08.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.853+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:38:08.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.854+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:38:08.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.858+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:38:08.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.868+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:38:08.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.882+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:38:08.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.901+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:38:08.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.919+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:38:08.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.921+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:38:08.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.922+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:38:08.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.935+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:38:08.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.937+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:38:08.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.940+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:38:08.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:38:08.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.970+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:38:08.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.988+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:38:08.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:08.990+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:09.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.001+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:38:09.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.017+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:38:09.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.017+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:38:09.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.019+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:09.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.038+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:38:09.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.045+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:38:09.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.064+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:38:09.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.065+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:38:09.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.077+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:09.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.094+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:38:09.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.103+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:38:09.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.108+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:38:09.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:38:09.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.119+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:38:09.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.128+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:38:09.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.153+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:38:09.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.160+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:38:09.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.160+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:38:09.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.169+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:38:09.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.188+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:38:09.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.219+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:38:09.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.229+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:38:09.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.242+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:38:09.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.251+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:38:09.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.273+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:38:09.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.289+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:09.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.318+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:38:09.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.339+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:38:09.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.357+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:38:09.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.357+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:38:09.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.363+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:09.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.364+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:38:09.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.398+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:38:09.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.418+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:38:09.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.434+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:38:09.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.458+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:38:09.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.473+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:38:09.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.478+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:38:09.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.479+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:38:09.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.495+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:38:09.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.547+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:38:09.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:38:09.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.557+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:38:09.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.560+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:09.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.600+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:38:09.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.608+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:38:09.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.618+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:38:09.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.626+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:38:09.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.637+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:38:09.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.652+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:38:09.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.665+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:38:09.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.668+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:38:09.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.671+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:38:09.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.690+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:38:09.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.699+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:38:09.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.722+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:09.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.739+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:38:09.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 106 16 1442857 1442841 850.658 873.125 0.000405739 0.00116477 2024-09-17T16:38:09.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.751+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:38:09.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.758+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:38:09.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.758+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:38:09.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.759+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:38:09.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.770+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:38:09.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.805+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:38:09.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.809+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:38:09.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.823+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:38:09.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.841+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:38:09.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.849+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:38:09.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:38:09.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.865+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:38:09.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.877+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:38:09.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.886+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:38:09.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.887+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:38:09.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:38:09.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.894+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:38:09.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.897+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:38:09.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.926+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:38:09.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.932+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:38:09.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.953+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:38:09.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.982+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:38:09.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.986+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:38:09.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:09.994+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:10.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.001+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:38:10.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.017+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:38:10.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.023+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:38:10.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.034+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:38:10.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.040+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:38:10.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.046+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:38:10.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.079+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:38:10.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.080+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:38:10.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.092+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:38:10.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.111+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:38:10.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.115+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:38:10.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.118+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:38:10.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.135+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:38:10.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.138+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:38:10.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.147+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:38:10.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.172+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:10.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.193+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:38:10.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.200+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:38:10.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.208+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:38:10.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.225+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:38:10.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.239+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:38:10.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.245+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:38:10.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.246+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:38:10.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.261+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:38:10.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.270+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:38:10.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.270+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:38:10.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.289+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:38:10.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.297+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:38:10.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.298+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:38:10.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.313+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:38:10.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:10.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.349+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:38:10.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.367+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:38:10.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.368+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:38:10.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.378+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:38:10.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.418+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:38:10.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.427+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:38:10.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.431+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:38:10.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:38:10.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.455+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:38:10.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.472+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:38:10.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.475+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:38:10.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.477+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:38:10.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.505+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:38:10.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.514+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:10.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.521+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:38:10.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.530+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:38:10.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.546+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:38:10.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.559+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:38:10.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.561+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:38:10.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.563+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:38:10.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.566+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:38:10.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.580+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:38:10.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.595+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:10.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.601+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:10.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.612+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:38:10.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.628+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:38:10.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.649+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:38:10.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.661+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:38:10.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.671+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:38:10.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.686+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:10.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.688+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:38:10.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.702+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:38:10.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.723+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:38:10.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.733+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:38:10.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:38:10.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 107 16 1456665 1456649 850.773 863 0.0016315 0.00116462 2024-09-17T16:38:10.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.759+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:38:10.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.760+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:38:10.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.767+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:38:10.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.786+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:38:10.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.793+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:38:10.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.795+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:38:10.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.817+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:38:10.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.820+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:38:10.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.832+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:38:10.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.837+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:38:10.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.837+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:38:10.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.853+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:38:10.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.863+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:38:10.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.874+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:38:10.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.885+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:38:10.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.914+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:38:10.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.922+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:38:10.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:38:10.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:38:10.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.948+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:38:10.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.972+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:38:10.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.973+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:38:10.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:10.990+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:38:11.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.000+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:11.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.019+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:38:11.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.022+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:38:11.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.037+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:38:11.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.054+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:38:11.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.068+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:38:11.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.074+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:38:11.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.076+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:38:11.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.099+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:38:11.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.100+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:38:11.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.140+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:38:11.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.148+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:38:11.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.155+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:38:11.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.175+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:11.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.179+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:38:11.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.188+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:38:11.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.206+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:38:11.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:38:11.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.242+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:38:11.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.260+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:38:11.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.261+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:38:11.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.275+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:38:11.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:38:11.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.303+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:38:11.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.311+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:38:11.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.313+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:38:11.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.348+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:38:11.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.358+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:38:11.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.358+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:11.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.368+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:38:11.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.379+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:38:11.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.381+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:38:11.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.385+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:38:11.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.400+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:38:11.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.411+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:38:11.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.414+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:38:11.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.425+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:38:11.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.428+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:38:11.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.454+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:38:11.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.459+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:38:11.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.462+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:38:11.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.468+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:38:11.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.499+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:38:11.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.500+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:38:11.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.509+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:38:11.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.528+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:38:11.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.534+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:38:11.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.558+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:38:11.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.560+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:11.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:38:11.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.578+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:38:11.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:38:11.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.606+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:38:11.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.622+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:38:11.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.625+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:38:11.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.626+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:38:11.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.641+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:38:11.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.743+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:38:11.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 108 16 1470542 1470526 850.925 867.312 0.000718777 0.00116442 2024-09-17T16:38:11.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.761+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:38:11.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.764+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:38:11.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.775+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:38:11.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.786+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:38:11.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.788+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:38:11.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.794+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:38:11.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.818+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:38:11.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.820+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:38:11.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.838+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:11.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.844+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:38:11.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.850+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:38:11.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.868+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:38:11.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.875+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:38:11.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.891+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:38:11.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.928+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:38:11.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.944+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:38:11.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.947+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:38:11.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.951+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:38:11.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.955+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:38:11.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.979+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:38:11.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.980+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:38:11.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:11.988+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:12.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.000+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:38:12.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:38:12.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.021+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:38:12.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.034+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:38:12.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.040+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:38:12.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.068+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:38:12.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.090+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:38:12.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:38:12.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.099+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:38:12.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.102+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:38:12.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.130+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:38:12.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.131+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:38:12.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.142+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:38:12.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.143+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:38:12.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.170+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:38:12.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.178+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:38:12.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.186+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:38:12.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.212+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:38:12.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.238+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:38:12.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.257+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:12.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.260+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:38:12.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.273+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:38:12.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.287+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:38:12.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.312+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:38:12.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:38:12.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.323+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:38:12.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.324+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:38:12.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.345+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:38:12.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.346+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:38:12.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.354+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:38:12.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.365+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:38:12.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.371+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:38:12.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.391+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:38:12.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.399+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:38:12.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.412+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:38:12.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.435+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:12.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:38:12.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.457+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:38:12.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.457+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:38:12.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.460+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:38:12.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.473+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:38:12.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.498+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:12.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.508+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:38:12.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.518+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:38:12.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.522+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:38:12.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.527+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:38:12.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.547+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:38:12.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.548+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:38:12.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.567+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:38:12.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.589+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:38:12.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.611+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:38:12.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.619+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:38:12.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.626+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:38:12.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.626+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:38:12.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.627+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:38:12.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.648+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:38:12.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.667+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:38:12.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.675+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:38:12.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.706+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:38:12.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.719+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:38:12.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.733+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:38:12.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.734+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:38:12.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.742+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:38:12.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 109 16 1484497 1484481 851.119 872.188 0.000628829 0.00116414 2024-09-17T16:38:12.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.755+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:38:12.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.761+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:38:12.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.768+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:38:12.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.770+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:38:12.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.779+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:38:12.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.789+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:38:12.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.792+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:38:12.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.819+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:38:12.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.823+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:38:12.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.847+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:38:12.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.847+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:38:12.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.847+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:38:12.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.860+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:38:12.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.862+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:12.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.880+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:38:12.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.913+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:38:12.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.918+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:38:12.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:38:12.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.931+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:38:12.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.953+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:38:12.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.956+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:38:12.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.960+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:38:12.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.976+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:12.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.993+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:38:12.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:12.996+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:38:13.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.001+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:38:13.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.021+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:38:13.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.046+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:38:13.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:38:13.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:38:13.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.091+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:38:13.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:38:13.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.112+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:38:13.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.129+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:38:13.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.138+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:38:13.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.157+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:38:13.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.187+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:38:13.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.210+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:38:13.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.212+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:13.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:38:13.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.235+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:38:13.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.250+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:38:13.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.274+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:38:13.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.287+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:38:13.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.302+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:38:13.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.308+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:38:13.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.320+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:38:13.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.339+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:38:13.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.344+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:38:13.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.357+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:38:13.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.375+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:38:13.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.391+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:38:13.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.425+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:38:13.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:38:13.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.429+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:38:13.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.449+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:38:13.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.462+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:38:13.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.471+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:38:13.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.477+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:38:13.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.482+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:38:13.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.489+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:38:13.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.510+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:38:13.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.544+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:13.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.551+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:38:13.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.560+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:38:13.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.561+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:38:13.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.570+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:38:13.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.581+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:38:13.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:38:13.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.614+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:38:13.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.636+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:38:13.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.642+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:13.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.644+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:38:13.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.665+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:38:13.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.675+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:38:13.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.685+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:38:13.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.697+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:38:13.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.703+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:38:13.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.713+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:38:13.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.727+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:13.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 110 16 1498628 1498612 851.41 883.188 0.000596145 0.00116375 2024-09-17T16:38:13.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.747+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:38:13.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.775+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:38:13.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.797+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:38:13.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.824+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:38:13.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.827+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:38:13.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.833+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:38:13.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.881+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:38:13.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.899+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:38:13.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.912+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:38:13.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.930+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:38:13.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:38:13.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.958+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:38:13.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.966+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:38:13.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.973+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:13.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.979+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:38:13.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.983+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:38:13.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:13.993+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:38:14.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.020+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:38:14.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.049+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:38:14.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.050+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:38:14.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.058+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:38:14.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.063+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:38:14.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.076+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:38:14.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.095+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:38:14.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.115+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:38:14.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.152+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:38:14.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.162+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:38:14.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.179+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:38:14.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:38:14.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.184+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:38:14.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.190+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:38:14.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.217+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:38:14.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.218+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:38:14.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.240+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:38:14.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.249+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:38:14.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.253+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:38:14.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.253+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:38:14.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.268+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:38:14.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.303+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:38:14.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.310+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:38:14.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.329+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:14.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.333+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:38:14.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:38:14.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.356+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:38:14.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.358+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:38:14.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.378+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:14.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.379+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:14.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.392+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:38:14.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.404+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:38:14.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.420+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:38:14.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.433+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:38:14.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.436+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:38:14.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.438+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:38:14.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.462+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:38:14.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.471+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:38:14.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.487+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:38:14.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.497+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:38:14.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.515+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:38:14.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.529+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:38:14.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.558+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:38:14.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.562+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:38:14.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.573+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:38:14.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.574+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:38:14.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.579+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:38:14.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.594+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:38:14.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.601+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:38:14.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.618+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:38:14.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.637+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:14.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.646+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:38:14.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.650+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:38:14.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.655+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:38:14.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.663+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:38:14.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.670+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:38:14.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.678+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:38:14.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.680+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:38:14.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.688+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:38:14.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.713+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:38:14.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:38:14.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 111 16 1512688 1512672 851.656 878.75 0.000994866 0.00116337 2024-09-17T16:38:14.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.758+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:38:14.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.785+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:38:14.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.788+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:38:14.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.802+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:38:14.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.812+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:38:14.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.839+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:38:14.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.846+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:38:14.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.853+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:38:14.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.854+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:38:14.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.887+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:38:14.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.888+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:14.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.892+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:38:14.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.907+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:38:14.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.930+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:38:14.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.932+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:38:14.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.938+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:38:14.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.949+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:38:14.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.954+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:38:14.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.958+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:38:14.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:14.981+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:38:15.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.000+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:38:15.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.000+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:38:15.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.002+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:38:15.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.009+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:38:15.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.016+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:15.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.035+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:38:15.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.037+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:38:15.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.045+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:38:15.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.060+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:38:15.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.076+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:38:15.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.091+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:38:15.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.098+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:38:15.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.132+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:38:15.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.143+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:38:15.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.181+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:38:15.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.183+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:38:15.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.206+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:38:15.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.280+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:38:15.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.303+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:38:15.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.307+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:38:15.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.326+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:38:15.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.331+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:15.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.347+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:38:15.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.360+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:38:15.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.367+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:38:15.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.367+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:38:15.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.392+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:38:15.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.401+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:38:15.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.410+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:38:15.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.414+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:38:15.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.430+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:38:15.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.439+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:38:15.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.441+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:38:15.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.452+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:38:15.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.458+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:38:15.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.494+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:38:15.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.496+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:38:15.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.525+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:38:15.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.530+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:38:15.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.559+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:38:15.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.561+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:38:15.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.568+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:38:15.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.589+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:38:15.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.595+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:38:15.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.596+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:38:15.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.597+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:38:15.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.604+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:38:15.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:38:15.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.625+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:38:15.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.632+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:38:15.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.677+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:38:15.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.677+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:38:15.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.678+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:38:15.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.700+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:38:15.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.707+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:38:15.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.708+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:38:15.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.723+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:38:15.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.740+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:38:15.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 112 16 1525832 1525816 851.386 821.5 0.000974804 0.00116376 2024-09-17T16:38:15.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.754+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:38:15.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.763+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:38:15.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.767+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:38:15.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.776+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:38:15.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.798+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:38:15.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.806+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:38:15.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.806+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:38:15.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.828+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:38:15.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.844+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:38:15.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.863+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:38:15.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.873+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:38:15.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.884+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:38:15.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.891+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:38:15.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.897+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:38:15.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.936+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:38:15.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.954+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:38:15.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.970+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:38:15.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.974+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:38:15.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.974+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:38:15.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:15.996+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:38:16.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.027+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:38:16.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.032+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:38:16.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.036+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:38:16.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.055+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:38:16.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.075+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:38:16.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.088+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:38:16.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.108+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:38:16.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.119+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:38:16.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.134+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:38:16.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.150+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:38:16.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.153+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:38:16.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.164+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:38:16.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.177+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:38:16.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.184+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:16.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.203+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:38:16.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.207+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:38:16.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.244+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:38:16.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.248+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:38:16.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.251+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:38:16.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.258+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:38:16.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.266+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:38:16.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.283+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:38:16.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.301+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:38:16.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.307+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:38:16.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.335+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:38:16.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.338+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:38:16.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.351+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:38:16.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.356+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:38:16.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.373+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:38:16.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.379+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:38:16.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.395+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:38:16.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.411+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:16.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.426+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:38:16.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.426+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:38:16.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.441+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:38:16.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.443+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:16.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.454+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:38:16.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.461+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:38:16.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.470+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:38:16.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.474+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:16.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.491+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:38:16.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.502+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:38:16.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.517+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:38:16.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.523+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:38:16.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.528+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:38:16.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.544+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:38:16.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.550+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:38:16.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.563+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:16.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.566+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:16.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.580+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:38:16.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.597+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:38:16.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.606+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:16.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.623+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:38:16.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:38:16.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.650+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:38:16.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:38:16.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.670+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:38:16.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.686+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:38:16.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.689+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:38:16.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.703+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:38:16.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.717+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:38:16.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.719+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:38:16.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.728+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:38:16.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 113 15 1539388 1539373 851.349 847.312 0.000729103 0.00116382 2024-09-17T16:38:16.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.745+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:38:16.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.746+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:38:16.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.777+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:16.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.785+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:38:16.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.792+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:38:16.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.796+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:38:16.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.806+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:38:16.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.815+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:38:16.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.836+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:38:16.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:38:16.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.872+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:38:16.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.877+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:38:16.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.880+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:38:16.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.884+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:38:16.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.894+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:38:16.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.899+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:38:16.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.900+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:38:16.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.916+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:38:16.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.929+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:38:16.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.943+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:38:16.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.977+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:38:16.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.982+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:38:16.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.984+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:38:16.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:16.986+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:38:17.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.010+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:38:17.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.029+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:38:17.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.030+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:38:17.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.039+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:38:17.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.069+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:38:17.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.078+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:38:17.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.078+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:38:17.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.083+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:38:17.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.085+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:38:17.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.096+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:38:17.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.108+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:38:17.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.123+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:38:17.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.142+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:38:17.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.150+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:38:17.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.155+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:38:17.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.189+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:38:17.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.211+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:38:17.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.219+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:38:17.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.233+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:38:17.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.242+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:38:17.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.244+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:38:17.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.255+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:17.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.275+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:38:17.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.288+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:38:17.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.291+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:38:17.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.304+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:38:17.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.314+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:38:17.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.320+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:17.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.324+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:38:17.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.326+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:38:17.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.332+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:38:17.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.344+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:38:17.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.361+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:38:17.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.375+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:38:17.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.392+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:38:17.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.400+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:17.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.402+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:38:17.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.416+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:38:17.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.417+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:38:17.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.421+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:38:17.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.422+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:38:17.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.437+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:38:17.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.440+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:38:17.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.467+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:38:17.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:38:17.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.480+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:38:17.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.513+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:38:17.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.525+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:38:17.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.533+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:38:17.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.543+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:38:17.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.573+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:38:17.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.575+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:38:17.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.576+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:38:17.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.581+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:38:17.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.589+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:38:17.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.632+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:38:17.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.634+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:38:17.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:38:17.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.660+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:38:17.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:38:17.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.685+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:17.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.705+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:38:17.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.706+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:38:17.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.719+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:38:17.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.728+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:38:17.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:38:17.746 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 114 15 1552590 1552575 851.118 825.125 0.000912637 0.00116413 2024-09-17T16:38:17.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.759+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:38:17.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.784+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:17.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.802+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:38:17.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.807+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:38:17.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.829+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:38:17.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.838+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:38:17.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.872+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:38:17.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.885+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:38:17.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.905+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:38:17.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.909+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:17.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.916+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:38:17.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.918+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:38:17.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:38:17.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.943+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:38:17.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:38:17.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.973+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:17.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.985+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:38:17.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:17.987+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:38:18.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.016+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:38:18.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.019+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:38:18.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.031+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:38:18.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.038+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:38:18.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.063+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:38:18.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.064+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:38:18.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.072+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:38:18.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.073+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:38:18.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.083+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:38:18.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.093+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:38:18.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.102+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:38:18.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.111+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:38:18.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.123+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:38:18.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.129+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:38:18.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.152+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:38:18.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.180+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:38:18.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.180+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:38:18.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.189+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:38:18.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.193+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:38:18.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.201+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:38:18.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.209+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:38:18.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.224+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:38:18.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.239+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:38:18.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.245+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:38:18.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.251+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:38:18.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:38:18.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.298+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:38:18.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.301+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:38:18.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.325+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:38:18.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.338+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:38:18.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.339+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:38:18.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.346+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:38:18.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.374+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:38:18.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.397+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:38:18.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.397+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:38:18.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.423+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:18.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.442+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:18.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.447+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:38:18.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.452+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:38:18.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.475+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:38:18.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.477+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:38:18.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.493+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:38:18.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.498+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:38:18.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.509+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:38:18.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.524+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:38:18.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.524+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:38:18.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.528+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:38:18.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.539+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:18.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.550+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:38:18.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.568+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:38:18.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.571+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:38:18.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.595+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:38:18.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.614+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:38:18.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.616+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:38:18.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.622+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:38:18.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:38:18.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.675+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:38:18.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.678+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:38:18.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.681+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:38:18.863 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 115 16 1566366 1566350 851.203 860.938 0.000739385 0.001164 2024-09-17T16:38:18.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.686+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:38:18.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.716+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.721+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.757+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.758+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.773+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.779+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.799+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.827+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.834+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.846+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:38:18.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:38:18.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.863+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:38:18.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.869+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:38:18.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.869+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:38:18.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.873+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:38:18.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.894+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:38:18.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.903+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:38:18.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.920+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:38:18.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.935+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:18.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.938+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:38:18.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.953+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:38:18.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.962+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:38:18.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.963+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:38:18.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.971+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:38:19.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.999+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:38:19.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:18.999+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:38:19.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:38:19.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.025+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:38:19.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.026+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:38:19.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.036+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:38:19.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.071+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:38:19.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:38:19.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.096+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:38:19.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.101+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:38:19.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.131+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:19.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.138+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:19.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.140+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:19.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.154+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:38:19.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.170+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:38:19.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.172+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:38:19.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.193+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:38:19.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.197+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:38:19.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.218+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:38:19.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:38:19.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.259+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:38:19.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.261+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:38:19.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.275+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:38:19.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.281+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:19.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.284+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:38:19.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.313+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:38:19.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.352+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:38:19.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.356+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:38:19.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.372+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:38:19.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.383+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:38:19.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.401+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:38:19.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.410+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:38:19.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.417+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:38:19.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.430+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:38:19.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:38:19.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.444+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:38:19.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.450+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:38:19.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.459+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:38:19.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.474+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:38:19.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.474+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:38:19.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.477+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:38:19.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.493+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:38:19.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.502+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:19.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.536+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:38:19.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.548+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:38:19.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.552+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:38:19.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.567+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:38:19.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.588+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:38:19.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.591+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:38:19.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.610+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:38:19.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.611+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:38:19.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.640+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:38:19.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.640+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:38:19.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.646+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:38:19.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.656+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:38:19.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.684+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:38:19.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.698+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:19.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.707+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:38:19.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.715+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:38:19.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.741+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:38:19.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 116 16 1580358 1580342 851.403 874.5 0.00115905 0.00116375 2024-09-17T16:38:19.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.764+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:38:19.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.788+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:38:19.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.800+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:38:19.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.801+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:38:19.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.827+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:19.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.833+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:38:19.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.838+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:38:19.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.856+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:19.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.860+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:38:19.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.864+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:38:19.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.900+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:19.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.902+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:38:19.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.912+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:38:19.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.913+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:38:19.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.939+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:38:19.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:19.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.969+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:38:19.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.975+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:38:19.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.979+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:19.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:19.991+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:38:20.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.012+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:38:20.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.029+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:38:20.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.042+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:38:20.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.059+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:38:20.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:38:20.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.067+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:38:20.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.068+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:38:20.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.082+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:38:20.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.098+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:38:20.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.103+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:38:20.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.116+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:38:20.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.116+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:38:20.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.137+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:38:20.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:38:20.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:38:20.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.188+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:38:20.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.199+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:38:20.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.219+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:38:20.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.226+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:38:20.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.297+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:38:20.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.305+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:38:20.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.317+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:38:20.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.337+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:38:20.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.349+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:38:20.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.350+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:38:20.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.376+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:38:20.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.383+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:38:20.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.389+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:38:20.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.400+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:38:20.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.402+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:38:20.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.414+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:38:20.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.422+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:38:20.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.439+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:38:20.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.442+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:38:20.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.463+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:38:20.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.475+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:38:20.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.477+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:38:20.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.487+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:38:20.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.496+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:38:20.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.508+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:38:20.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.512+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:38:20.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.520+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:38:20.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.548+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:38:20.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.548+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:38:20.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.554+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:20.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.567+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:38:20.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.590+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:38:20.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.619+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:20.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.620+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:38:20.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.632+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:38:20.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.635+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:38:20.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.643+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:38:20.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:38:20.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.681+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:38:20.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.697+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:38:20.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.699+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:38:20.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.707+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:38:20.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.719+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:38:20.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.728+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:20.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 117 16 1593334 1593318 851.057 811 0.000634223 0.00116421 2024-09-17T16:38:20.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.745+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:20.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:38:20.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.769+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:38:20.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.771+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:38:20.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.784+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:20.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.815+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:38:20.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.835+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:38:20.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.844+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:38:20.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.845+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:38:20.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:38:20.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.858+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:38:20.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.870+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:38:20.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.880+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:38:20.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.882+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:38:20.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.895+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:38:20.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.898+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:38:20.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.906+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:38:20.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.928+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:38:20.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.941+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:38:20.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.955+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:38:20.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.958+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:38:20.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.981+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:38:20.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.983+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:38:20.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.985+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:38:20.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.994+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:38:21.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:20.997+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:38:21.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.023+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:38:21.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.040+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:38:21.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:38:21.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.054+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:38:21.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.069+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:38:21.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.070+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:38:21.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.087+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:38:21.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.090+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:38:21.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.093+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:21.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.122+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:38:21.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.126+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:38:21.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.136+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:38:21.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.145+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:38:21.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.158+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:38:21.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.159+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:38:21.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.166+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:38:21.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.168+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:38:21.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.186+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:38:21.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.203+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:38:21.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.231+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:38:21.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.237+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:38:21.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.241+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:38:21.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.262+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:38:21.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.277+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:38:21.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.280+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:38:21.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.289+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:38:21.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.299+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:38:21.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:38:21.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.323+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:38:21.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.326+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:38:21.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.336+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:38:21.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.338+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:38:21.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.346+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:38:21.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.386+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:38:21.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.392+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:38:21.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.398+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:38:21.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.420+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:38:21.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.461+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:38:21.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.510+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:38:21.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.514+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:38:21.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.529+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:38:21.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.543+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:38:21.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.555+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:38:21.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.561+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:38:21.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.567+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:38:21.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.587+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:38:21.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.601+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:38:21.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.605+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:38:21.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.606+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:38:21.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.607+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:21.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.618+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:21.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.628+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:38:21.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.665+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:38:21.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.665+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:38:21.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.688+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:38:21.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.698+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:38:21.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.716+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:38:21.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.729+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:38:21.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.734+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:38:21.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 118 15 1607065 1607050 851.118 858.25 0.000977957 0.00116414 2024-09-17T16:38:21.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.745+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:38:21.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.751+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:38:21.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.758+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:38:21.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.768+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:38:21.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.771+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:38:21.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.801+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:38:21.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.801+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:38:21.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.806+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:38:21.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.828+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:38:21.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.837+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:38:21.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.838+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:38:21.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.839+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:38:21.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.865+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:38:21.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.877+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:38:21.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:38:21.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.930+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:38:21.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.930+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:38:21.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.931+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:38:21.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.940+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:38:21.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.941+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:38:21.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.960+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:38:21.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.978+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:38:21.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:21.985+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:38:22.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.000+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:38:22.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.015+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:38:22.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.045+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:38:22.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.048+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:38:22.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.054+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:38:22.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.060+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:38:22.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.090+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:38:22.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.094+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:38:22.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.099+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:38:22.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.111+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:38:22.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.138+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:38:22.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.143+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:38:22.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.169+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:38:22.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.173+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:38:22.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.191+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:38:22.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.193+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:38:22.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.229+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:38:22.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.238+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:38:22.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.251+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:38:22.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.265+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:38:22.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.287+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:38:22.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.288+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:38:22.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.295+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:38:22.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.311+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:38:22.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.316+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:38:22.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.324+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:22.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.344+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:38:22.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.354+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:38:22.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.361+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:38:22.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.367+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:38:22.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.402+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:38:22.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.412+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:38:22.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.421+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:38:22.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.429+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:38:22.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.441+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:38:22.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.462+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:38:22.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:38:22.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.496+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:22.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.509+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:38:22.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.512+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:38:22.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.539+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:38:22.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.544+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:38:22.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.561+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:38:22.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.595+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:22.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.622+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:38:22.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.629+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:38:22.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.638+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:38:22.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.640+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:38:22.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.654+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:38:22.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.684+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:38:22.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.704+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:38:22.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:38:22.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.715+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:38:22.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:38:22.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 119 15 1621074 1621059 851.323 875.562 0.00129135 0.00116386 2024-09-17T16:38:22.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.761+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:38:22.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.780+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:38:22.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.785+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:38:22.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.785+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:38:22.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.812+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:38:22.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.816+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:38:22.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.817+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:38:22.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.828+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:38:22.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.838+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:38:22.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.853+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:38:22.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.873+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:38:22.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.878+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:38:22.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.894+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:38:22.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:38:22.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.912+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:38:22.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.926+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:38:22.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.926+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:38:22.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.937+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:38:22.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.942+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:22.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.962+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:38:22.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.968+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:38:22.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.988+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:38:23.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:22.999+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:38:23.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.003+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:38:23.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.003+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:38:23.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.010+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:38:23.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.025+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:38:23.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.053+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:38:23.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.054+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:38:23.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.054+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:38:23.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.058+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:38:23.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.063+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:38:23.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.078+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:38:23.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.087+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:23.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.103+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:38:23.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.114+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:38:23.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.122+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:23.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.130+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:38:23.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.139+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:38:23.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.171+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:38:23.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.175+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:38:23.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.177+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:38:23.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.198+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:38:23.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.199+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:38:23.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.236+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:38:23.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.238+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:38:23.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.254+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:38:23.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.269+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:38:23.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.272+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:38:23.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.280+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:38:23.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:38:23.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.287+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:38:23.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.289+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:38:23.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.300+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:38:23.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.306+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:23.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.323+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.333+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:38:23.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.353+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:38:23.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.363+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:38:23.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.366+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:38:23.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.387+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:38:23.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.390+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:38:23.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.407+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:38:23.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.411+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:38:23.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.419+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:38:23.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.437+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:38:23.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.441+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:38:23.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.455+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:38:23.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.466+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:38:23.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:23.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.487+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:38:23.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.491+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:38:23.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.503+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:38:23.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.505+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:38:23.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.521+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:38:23.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.530+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:38:23.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.563+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:38:23.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.569+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:38:23.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.588+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:38:23.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.591+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:38:23.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.612+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:38:23.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.614+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:38:23.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.651+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:38:23.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.664+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:38:23.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:38:23.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.679+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:38:23.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.692+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:38:23.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.712+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:38:23.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:38:23.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.723+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:38:23.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.733+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:38:23.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.734+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:38:23.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:38:23.746209+0000 min lat: 0.000227768 max lat: 0.114701 avg lat: 0.00116409 2024-09-17T16:38:23.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:38:23.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 120 16 1634372 1634356 851.153 831.062 0.00109336 0.00116409 2024-09-17T16:38:23.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.759+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:38:23.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.765+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:38:23.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.776+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:38:23.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.779+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:38:23.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.782+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:38:23.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.822+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:23.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.824+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:38:23.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.833+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:38:23.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.854+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:38:23.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.855+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:38:23.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.856+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:38:23.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.872+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:38:23.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.881+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:38:23.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.884+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:38:23.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.908+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:38:23.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.926+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:38:23.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.935+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:38:23.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.962+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:38:23.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.970+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:38:23.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.986+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:38:23.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:23.992+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:24.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.006+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:38:24.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.014+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:38:24.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.017+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:38:24.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.022+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:38:24.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.022+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:38:24.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.065+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:24.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.083+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:38:24.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.088+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:38:24.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.093+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:38:24.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.103+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:24.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.124+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:38:24.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.136+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:38:24.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.144+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:38:24.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.145+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:38:24.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.173+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:38:24.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.188+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:38:24.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.197+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:38:24.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.203+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:38:24.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.207+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:38:24.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:38:24.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.233+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:38:24.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.234+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:38:24.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.261+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:38:24.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.267+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:38:24.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:38:24.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.278+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:38:24.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.279+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:38:24.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.311+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:24.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.313+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:38:24.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.330+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:38:24.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.343+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:38:24.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.351+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:38:24.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.357+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:38:24.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.375+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:38:24.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.388+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:38:24.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.390+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:38:24.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.395+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:24.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.419+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:38:24.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.421+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:38:24.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.426+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:38:24.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.438+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:38:24.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.444+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:24.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.467+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:38:24.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.472+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:38:24.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.484+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:38:24.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.496+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:38:24.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.515+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:38:24.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.515+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:38:24.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.516+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:38:24.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.541+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:38:24.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.551+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:38:24.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:38:24.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.577+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:38:24.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.592+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:38:24.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.592+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:38:24.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.604+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:24.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.612+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:38:24.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.639+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:38:24.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.655+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:38:24.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.664+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:38:24.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.673+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:38:24.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.677+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:38:24.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.679+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:38:24.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.698+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:38:24.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.712+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:38:24.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.728+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:38:24.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.737+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:38:24.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.737+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:38:24.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 121 16 1648252 1648236 851.288 867.5 0.000650137 0.00116391 2024-09-17T16:38:24.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.754+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:38:24.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.758+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:38:24.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.790+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:38:24.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.794+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:24.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.807+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:38:24.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.815+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:38:24.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.815+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:38:24.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.823+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:38:24.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.861+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:38:24.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.879+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:38:24.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.888+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:38:24.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.893+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:38:24.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.904+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:38:24.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.917+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:38:24.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.933+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:38:24.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.937+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:38:24.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.948+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:38:24.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.952+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:38:24.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.961+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:38:24.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.970+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:38:24.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.989+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:38:24.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.992+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:38:24.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:24.995+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:38:25.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.010+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:38:25.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.034+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:38:25.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:38:25.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.053+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:38:25.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.059+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:38:25.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.067+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:38:25.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.104+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:38:25.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:38:25.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.167+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:38:25.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.185+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:38:25.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.191+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:38:25.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.202+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:38:25.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.202+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:38:25.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.217+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:38:25.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.229+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:38:25.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.239+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:38:25.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.250+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:38:25.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.300+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:38:25.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.301+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:38:25.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.301+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:38:25.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.308+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:38:25.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.334+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:38:25.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.339+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:38:25.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.349+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:38:25.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.358+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:38:25.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.372+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:38:25.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.379+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:38:25.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:25.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:38:25.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.424+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:38:25.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.440+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:38:25.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.462+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:38:25.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.471+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:38:25.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.476+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:38:25.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.502+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:38:25.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.502+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:38:25.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.522+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:38:25.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.529+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:38:25.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.547+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:25.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.563+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:38:25.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.576+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:38:25.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.584+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:38:25.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:38:25.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.596+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:38:25.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.615+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:38:25.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:38:25.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.637+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:38:25.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.644+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:38:25.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.653+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:38:25.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.655+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:38:25.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.677+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:38:25.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.692+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:25.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.693+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:38:25.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.701+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:38:25.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.730+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:38:25.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.743+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:38:25.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 122 16 1661880 1661864 851.291 851.75 0.000660056 0.00116391 2024-09-17T16:38:25.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.753+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:38:25.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.765+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:38:25.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.774+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:38:25.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.776+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:25.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.782+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:38:25.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.802+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:25.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.807+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:38:25.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.850+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:38:25.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.858+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:38:25.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.864+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:38:25.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.889+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:38:25.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:38:25.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.903+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:38:25.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.926+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:38:25.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.931+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:38:25.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.942+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:38:25.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.947+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:38:25.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.952+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:38:25.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.957+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:38:25.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.957+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:38:25.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.987+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:38:25.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:25.990+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:38:26.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.002+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:38:26.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.005+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:38:26.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.026+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:38:26.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.029+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:38:26.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.034+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:38:26.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.049+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:26.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.050+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:38:26.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.067+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:38:26.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:38:26.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.099+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:38:26.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.105+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:38:26.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.110+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:38:26.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.122+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:38:26.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.150+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:38:26.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.176+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:38:26.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:38:26.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.193+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:38:26.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.206+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:38:26.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.215+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:38:26.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.221+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:38:26.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.224+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:38:26.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.232+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:38:26.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.249+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:38:26.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.266+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:26.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.276+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:38:26.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.281+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:38:26.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.303+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:38:26.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.307+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:38:26.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.318+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:38:26.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.322+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:38:26.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.330+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:38:26.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.340+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:38:26.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.352+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:38:26.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.368+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:38:26.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.373+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:38:26.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.380+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:38:26.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.384+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:38:26.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.416+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:38:26.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.423+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:38:26.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.427+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:38:26.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.436+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:38:26.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:38:26.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.447+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:38:26.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.468+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:38:26.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.488+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:38:26.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.499+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:38:26.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.510+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:38:26.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.526+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:38:26.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.543+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:38:26.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.544+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:38:26.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.545+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:38:26.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:38:26.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.586+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:38:26.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.588+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:26.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.619+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:38:26.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.631+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:38:26.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.647+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:38:26.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.665+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:38:26.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.666+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:38:26.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.683+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:38:26.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.700+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:38:26.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.710+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:38:26.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.733+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:38:26.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 123 16 1675650 1675634 851.366 860.625 0.000699899 0.00116381 2024-09-17T16:38:26.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.756+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:38:26.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.764+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:38:26.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.766+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:38:26.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.797+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:38:26.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.799+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:38:26.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.803+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:38:26.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.815+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:26.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.817+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:38:26.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.817+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:38:26.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.830+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:38:26.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.850+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:38:26.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.860+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:38:26.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.888+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:38:26.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.893+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:38:26.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.900+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:38:26.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.924+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:38:26.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.934+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:38:26.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.947+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:38:26.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.956+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:38:26.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.957+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:38:26.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:38:26.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.979+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:38:26.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.989+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:38:26.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.995+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:38:26.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:26.997+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:38:27.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.007+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:38:27.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.010+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:38:27.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.031+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:38:27.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.060+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:38:27.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.065+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:38:27.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.097+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:38:27.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.098+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:27.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.112+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:38:27.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.128+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:38:27.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.130+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:38:27.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.141+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:38:27.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.168+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:38:27.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.179+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:38:27.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.203+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:38:27.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.218+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:38:27.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.231+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:38:27.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.237+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:38:27.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.247+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:38:27.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.257+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:38:27.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.269+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:38:27.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:38:27.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.296+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:38:27.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.312+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:38:27.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.312+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:38:27.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:38:27.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.333+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:38:27.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.342+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:27.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.351+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:38:27.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.363+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:27.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.366+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:38:27.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.371+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:38:27.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.397+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:38:27.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.410+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:38:27.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:38:27.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.411+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:38:27.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.424+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:38:27.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.434+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:38:27.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.462+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:38:27.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.467+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:38:27.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.491+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:27.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.494+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:38:27.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.497+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:38:27.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.503+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:38:27.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.507+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:38:27.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.560+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:38:27.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.563+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:38:27.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.566+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:38:27.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.586+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:38:27.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.602+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:38:27.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.608+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:38:27.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:38:27.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.620+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:38:27.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.620+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:38:27.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.650+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:38:27.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.655+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:38:27.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.660+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:38:27.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.687+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:38:27.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.689+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:38:27.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.693+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:38:27.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.712+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:38:27.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.715+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:38:27.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.725+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:38:27.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 124 16 1689332 1689316 851.396 855.125 0.000904326 0.00116375 2024-09-17T16:38:27.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.752+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:38:27.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.757+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:27.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.780+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:38:27.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.796+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:38:27.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.797+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:38:27.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.802+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:27.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.825+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:38:27.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.827+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:38:27.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.829+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:38:27.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.844+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:38:27.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.894+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:27.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.901+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:38:27.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.912+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:38:27.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.915+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:38:27.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.919+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:38:27.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.926+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:38:27.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.938+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:27.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:38:27.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.944+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:38:27.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.968+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:38:27.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.983+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:38:27.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:27.984+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:38:28.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.003+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:38:28.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.012+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:38:28.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.023+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:38:28.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.026+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:38:28.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.035+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:38:28.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.063+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:38:28.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.064+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:38:28.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.084+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:38:28.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.097+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:38:28.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.103+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:38:28.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.116+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:38:28.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.129+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:38:28.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.129+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:38:28.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.144+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:38:28.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.149+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:38:28.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.161+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:38:28.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.172+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:38:28.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.178+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:38:28.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.189+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:38:28.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.204+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:28.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.219+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:38:28.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.227+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:38:28.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.240+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:28.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.268+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:38:28.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.269+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:38:28.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.292+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:38:28.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.294+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:38:28.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.295+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:38:28.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.310+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:38:28.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.325+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:38:28.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.344+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:38:28.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.345+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:38:28.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.354+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:38:28.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.368+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:38:28.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.393+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:38:28.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.412+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:38:28.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.416+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:28.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.422+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:38:28.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.437+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:38:28.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.445+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:38:28.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.457+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:38:28.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.460+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:28.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.481+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:38:28.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.485+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:38:28.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.506+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:38:28.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.510+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:38:28.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.522+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:38:28.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.522+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:38:28.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.530+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:38:28.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.535+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:38:28.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.550+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:38:28.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.576+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:38:28.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.578+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:38:28.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.578+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:38:28.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.581+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:38:28.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.600+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:38:28.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:38:28.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.634+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:38:28.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.640+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:38:28.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.652+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:38:28.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.653+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:38:28.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.655+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:38:28.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.657+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:38:28.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.664+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:38:28.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.671+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:38:28.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.685+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:38:28.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.706+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:38:28.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.737+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:38:28.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.742+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:38:28.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 125 15 1702977 1702962 851.407 852.875 0.000606436 0.00116374 2024-09-17T16:38:28.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.756+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:38:28.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.762+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:38:28.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.762+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:38:28.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.776+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:38:28.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.811+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:38:28.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.823+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:38:28.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.824+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:38:28.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.828+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:38:28.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.849+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:38:28.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.869+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:38:28.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.876+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:38:28.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.877+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:38:28.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.888+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:38:28.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.910+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:38:28.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.925+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:38:28.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.931+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:38:28.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.953+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:38:28.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.959+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:38:28.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.962+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:38:28.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.990+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:38:28.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:28.992+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:38:29.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.005+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:38:29.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.015+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:38:29.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.022+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:38:29.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.027+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:38:29.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.033+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:29.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.046+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:38:29.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.074+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:38:29.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.090+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:38:29.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.096+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:38:29.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.099+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:38:29.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.106+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:29.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.129+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:38:29.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.132+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:38:29.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.138+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:38:29.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.151+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:38:29.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.153+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:38:29.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.165+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:38:29.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.190+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:38:29.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.195+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:38:29.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.209+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:38:29.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.222+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:38:29.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.229+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:38:29.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.244+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:38:29.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.269+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:38:29.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.276+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:38:29.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.289+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:38:29.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.301+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:38:29.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.329+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:38:29.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.338+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:38:29.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.356+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:38:29.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.357+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:38:29.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.365+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:38:29.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.371+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:38:29.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.373+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:38:29.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.382+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:29.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.393+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:38:29.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.405+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:38:29.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.424+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:38:29.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.436+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:38:29.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.440+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:38:29.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.447+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:38:29.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.459+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:38:29.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.475+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:38:29.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.488+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:38:29.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.491+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:38:29.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.498+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:38:29.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.507+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:38:29.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.517+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:38:29.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.536+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:38:29.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.553+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:38:29.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.567+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:38:29.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.572+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:38:29.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:38:29.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.584+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:38:29.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.595+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:38:29.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.604+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:38:29.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.626+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:38:29.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.640+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:38:29.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.644+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:38:29.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.652+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:38:29.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.681+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:38:29.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.682+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:38:29.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.695+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:38:29.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.723+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:38:29.747 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 126 16 1716922 1716906 851.566 871.5 0.001053 0.00116353 2024-09-17T16:38:29.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.752+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:38:29.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.761+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:38:29.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.764+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:38:29.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.765+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:38:29.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.778+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:38:29.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.796+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:38:29.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.802+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:38:29.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.812+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:38:29.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.814+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:38:29.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.825+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:38:29.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.827+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:29.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.832+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:38:29.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.843+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:38:29.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.870+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:29.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.874+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:38:29.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.881+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:38:29.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.892+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:38:29.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.893+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:38:29.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.894+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:38:29.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.946+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:38:29.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.957+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:38:29.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.972+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:38:29.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.974+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:38:29.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.976+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:38:29.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.986+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:38:29.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:29.993+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:30.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.001+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:38:30.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.027+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:30.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.027+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:38:30.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.043+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:38:30.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.048+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:38:30.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.058+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:38:30.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.069+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:38:30.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.077+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:38:30.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.085+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:38:30.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.090+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:38:30.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.111+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:38:30.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.120+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:38:30.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.126+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:38:30.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.130+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:30.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.141+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:38:30.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.145+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:38:30.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.164+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:38:30.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.165+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:38:30.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.175+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:30.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.185+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:38:30.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.191+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:38:30.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.194+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:38:30.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.195+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:38:30.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.213+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:38:30.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.251+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:38:30.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.258+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:38:30.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.259+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:38:30.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.271+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:38:30.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:38:30.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.300+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:38:30.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.305+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:38:30.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.337+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:38:30.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.350+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:38:30.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.355+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:38:30.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.390+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:38:30.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.401+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:38:30.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.407+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:38:30.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.412+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:38:30.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.425+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:38:30.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.430+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:38:30.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.437+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:38:30.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.453+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:38:30.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.453+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:38:30.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.458+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:38:30.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.487+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:38:30.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.491+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:38:30.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.494+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:38:30.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.504+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:30.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.521+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:38:30.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.537+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:30.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.545+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:38:30.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.563+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:38:30.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.566+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:38:30.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.581+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:38:30.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.588+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:38:30.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.603+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:38:30.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.639+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:38:30.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.641+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:38:30.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.671+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:38:30.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.675+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:38:30.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.679+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:38:30.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.707+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:38:30.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.709+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:38:30.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.710+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:38:30.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.739+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:30.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 127 15 1730647 1730632 851.615 857.875 0.000847744 0.00116346 2024-09-17T16:38:30.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.757+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:38:30.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.758+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:38:30.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.773+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:38:30.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.778+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:38:30.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.785+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:38:30.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.800+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:38:30.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.825+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:30.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.843+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:38:30.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.848+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:38:30.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.862+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:38:30.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:38:30.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.874+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:38:30.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.880+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:38:30.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.896+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:38:30.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.903+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:38:30.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.926+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:38:30.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.926+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:38:30.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:38:30.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.964+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:38:30.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.974+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:38:30.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.977+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:38:30.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:30.986+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:38:31.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.006+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:38:31.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.025+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:38:31.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.050+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:38:31.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.067+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:38:31.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.074+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:38:31.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.075+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:38:31.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:31.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.102+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:38:31.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.108+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:38:31.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.110+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:31.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.121+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:38:31.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.133+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:38:31.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:38:31.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.151+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:38:31.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.164+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:38:31.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.169+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:38:31.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.181+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:38:31.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.192+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:38:31.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.197+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:38:31.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:38:31.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.213+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:38:31.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.263+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:38:31.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.282+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:38:31.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.297+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:38:31.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.301+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:38:31.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.313+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:38:31.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.320+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:38:31.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.321+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:38:31.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.339+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:38:31.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.349+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:38:31.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:38:31.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.378+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:38:31.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.387+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:38:31.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.389+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:38:31.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.395+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:38:31.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.413+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:38:31.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.414+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:38:31.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.415+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:31.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.432+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:38:31.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:38:31.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.463+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:38:31.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.472+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:38:31.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.473+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:38:31.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.500+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:38:31.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.513+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:38:31.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.526+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:38:31.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.534+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:38:31.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.551+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:38:31.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.562+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:38:31.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.570+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:38:31.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.571+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:38:31.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.596+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:38:31.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.597+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:38:31.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.598+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:38:31.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.604+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:38:31.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.632+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:38:31.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.655+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:38:31.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.660+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:38:31.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.675+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:38:31.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.687+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:38:31.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.701+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:38:31.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.707+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:38:31.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.720+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:38:31.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.722+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:38:31.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.725+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:31.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.743+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:38:31.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 128 16 1743852 1743836 851.408 825.25 0.00186849 0.00116373 2024-09-17T16:38:31.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.770+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:31.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.773+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:38:31.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.778+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:38:31.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.788+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:38:31.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.803+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:31.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.816+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:38:31.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.818+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:38:31.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.848+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:38:31.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.856+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:38:31.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.857+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:38:31.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.904+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:38:31.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.905+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:38:31.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.924+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:38:31.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.936+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:38:31.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:38:31.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.957+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:38:31.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.958+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:38:31.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.970+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:38:31.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.971+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:31.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.987+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:38:31.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.988+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:38:31.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.995+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:38:31.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:31.996+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:38:32.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.006+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:38:32.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.010+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:38:32.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.023+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:38:32.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.044+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:38:32.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.046+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:38:32.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.056+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:38:32.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.066+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:38:32.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.077+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:38:32.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.087+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:38:32.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.108+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:38:32.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.128+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:38:32.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.139+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:38:32.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.144+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:38:32.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.146+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:38:32.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.156+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:38:32.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.171+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:38:32.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.192+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:38:32.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.198+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:38:32.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.203+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:38:32.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.217+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:38:32.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.219+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:38:32.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.225+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:38:32.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.230+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:38:32.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.244+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:38:32.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.273+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:32.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.279+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:38:32.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.279+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:38:32.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.285+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:38:32.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.298+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:38:32.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:38:32.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.327+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:38:32.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.327+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:38:32.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.334+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:38:32.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.338+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:38:32.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.365+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:38:32.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.389+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:38:32.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.391+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:32.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.393+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:38:32.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.401+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:32.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.406+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:38:32.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.414+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:38:32.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.432+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:38:32.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.432+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:38:32.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.465+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:38:32.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.469+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:38:32.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.477+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:38:32.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.479+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:38:32.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.481+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:38:32.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.495+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:38:32.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.504+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:32.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.524+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:38:32.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.557+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:38:32.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.557+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:38:32.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.562+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:38:32.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:38:32.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.585+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:38:32.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.593+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:38:32.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.603+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:38:32.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.603+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:38:32.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.620+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:38:32.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.626+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:38:32.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.631+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:38:32.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:38:32.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.661+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:38:32.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.666+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:38:32.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.678+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:38:32.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.683+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:38:32.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.688+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:38:32.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.718+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:38:32.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.725+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:38:32.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.735+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:38:32.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 129 16 1757111 1757095 851.232 828.688 0.000845861 0.00116397 2024-09-17T16:38:32.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.748+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:38:32.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.766+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:38:32.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.785+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:38:32.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.785+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:38:32.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.800+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:38:32.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.811+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:38:32.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.825+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:38:32.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.828+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:38:32.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.862+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:38:32.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.869+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:38:32.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.878+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:38:32.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.888+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:38:32.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.891+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:38:32.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.897+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:38:32.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.906+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:38:32.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.909+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:38:32.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.922+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:38:32.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.947+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:38:32.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.948+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:38:32.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.974+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:38:32.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:32.996+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:38:33.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.002+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:38:33.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.002+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:38:33.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.019+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:38:33.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.029+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:38:33.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.075+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:38:33.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.078+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:38:33.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:38:33.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:38:33.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.100+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:38:33.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.110+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:33.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.127+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:38:33.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.142+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:38:33.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.151+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:38:33.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.160+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:38:33.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.164+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:38:33.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.170+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:38:33.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.207+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:38:33.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.211+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:38:33.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.227+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:38:33.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.229+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:38:33.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.245+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:38:33.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.261+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:38:33.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.272+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:38:33.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.279+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:38:33.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.281+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:38:33.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.295+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:38:33.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.321+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:38:33.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.325+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:38:33.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.334+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:38:33.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.362+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:38:33.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.365+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:38:33.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.367+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:38:33.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.386+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:38:33.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.399+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:38:33.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.408+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:38:33.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.425+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:38:33.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.436+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:38:33.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.437+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:38:33.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.452+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:38:33.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.455+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:38:33.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.471+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:38:33.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.477+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:38:33.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.490+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:38:33.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.506+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:38:33.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.523+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:38:33.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.523+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:38:33.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.549+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:38:33.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.553+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:38:33.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.574+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:38:33.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.587+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:38:33.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.592+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:38:33.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.596+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:38:33.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.598+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:38:33.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.620+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:33.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.627+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:38:33.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.631+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:38:33.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.635+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:38:33.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.649+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:33.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.657+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:38:33.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.670+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:38:33.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:38:33.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:38:33.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.720+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:38:33.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.733+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:38:33.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 130 16 1770764 1770748 851.247 853.312 0.00081174 0.00116397 2024-09-17T16:38:33.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.747+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:38:33.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.750+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:38:33.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.761+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:38:33.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.784+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:38:33.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.795+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:38:33.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.816+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:38:33.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.845+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:38:33.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.850+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:38:33.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.861+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:38:33.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.868+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:38:33.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.874+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:38:33.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.883+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:38:33.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.888+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:38:33.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.923+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:38:33.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.924+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:38:33.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.926+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:38:33.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.928+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:38:33.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.952+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:38:33.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.964+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:38:33.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.988+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:38:33.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:33.991+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:38:34.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.016+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:38:34.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.019+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:38:34.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.044+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:38:34.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.049+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:34.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.063+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:38:34.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.073+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:38:34.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.079+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:38:34.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.101+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:38:34.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.109+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:38:34.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.117+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:38:34.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.117+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:38:34.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.127+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:38:34.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.146+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:38:34.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.149+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:38:34.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.174+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:38:34.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.179+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:38:34.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.198+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:38:34.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.214+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:38:34.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.217+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:38:34.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.222+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:34.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.229+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:38:34.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.251+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:38:34.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.257+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:38:34.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.273+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:38:34.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.282+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:34.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.285+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:38:34.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.299+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:38:34.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.317+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:38:34.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.331+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:38:34.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.350+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:38:34.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.354+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:38:34.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.354+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:38:34.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.384+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:38:34.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.393+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:38:34.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.406+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:34.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.433+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:38:34.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.437+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:38:34.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.449+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:38:34.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.456+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:38:34.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.466+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:38:34.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.471+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:38:34.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.510+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:38:34.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.533+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:38:34.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.537+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:38:34.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.545+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:38:34.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.548+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:38:34.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.551+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:38:34.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.578+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:38:34.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.585+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:38:34.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.597+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:38:34.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.620+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:38:34.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.633+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:38:34.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.637+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:38:34.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.641+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:38:34.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.648+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:34.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.652+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:38:34.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.661+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:38:34.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.673+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:38:34.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.694+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:38:34.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.695+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:38:34.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.709+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:34.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.717+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:38:34.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.717+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:38:34.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 131 16 1784720 1784704 851.407 872.25 0.0291372 0.00116371 2024-09-17T16:38:34.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.749+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:38:34.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.785+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:38:34.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.803+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:38:34.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.820+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:38:34.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.822+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:38:34.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.844+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:38:34.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.858+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:34.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.859+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:38:34.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.859+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:38:34.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.873+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:38:34.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.888+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:38:34.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.918+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:38:34.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:38:34.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.943+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:38:34.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.944+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:38:34.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.957+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:38:34.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:38:34.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.963+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:38:34.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.979+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:38:34.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.981+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:38:34.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:34.985+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:38:35.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.013+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:38:35.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.033+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:38:35.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.034+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:35.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.058+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:38:35.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.066+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:38:35.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.074+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:38:35.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.081+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:38:35.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:38:35.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.110+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:38:35.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.118+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:38:35.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.161+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:38:35.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.171+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:38:35.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:38:35.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.173+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:38:35.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.187+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:38:35.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.209+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:38:35.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:38:35.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.238+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:38:35.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.286+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:38:35.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.301+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:38:35.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.307+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:38:35.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.323+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:38:35.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.326+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:38:35.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.337+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:38:35.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.342+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:38:35.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.352+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:38:35.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.368+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:38:35.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.393+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:38:35.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.397+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:38:35.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.418+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:38:35.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.419+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:35.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.430+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:38:35.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.430+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:38:35.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.446+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:38:35.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.490+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:38:35.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.497+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:38:35.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.499+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:38:35.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.515+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:38:35.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.544+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:38:35.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.559+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:35.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.564+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:38:35.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.574+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:38:35.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.579+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:38:35.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.580+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:38:35.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.610+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:38:35.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.634+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:35.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.636+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:38:35.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.641+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:38:35.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.655+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:38:35.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.660+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:38:35.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.681+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:35.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.686+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:38:35.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.699+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:38:35.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.701+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:38:35.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.709+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:38:35.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.720+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:38:35.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.732+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:38:35.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.737+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:38:35.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.741+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:38:35.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 132 16 1798121 1798105 851.302 837.562 0.00384105 0.00116386 2024-09-17T16:38:35.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.750+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:38:35.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.751+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:38:35.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.772+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:38:35.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.794+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:38:35.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.802+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:35.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.807+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:35.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.835+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:38:35.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.837+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:38:35.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:38:35.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.869+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:38:35.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.874+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:38:35.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.896+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:35.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.907+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:38:35.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.907+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:38:35.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.914+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:38:35.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.920+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:38:35.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.944+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:38:35.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.954+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:35.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.954+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:38:35.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:35.994+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:38:36.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.000+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:38:36.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.003+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:38:36.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.022+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:38:36.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.037+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:38:36.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.051+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:38:36.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.061+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:38:36.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.080+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:38:36.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.090+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:38:36.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.103+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:38:36.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.113+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:38:36.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:36.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.131+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:38:36.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.152+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:38:36.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.155+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:38:36.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.168+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:38:36.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.169+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:38:36.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:38:36.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.202+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:38:36.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.223+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:38:36.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.243+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:38:36.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.246+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:38:36.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.246+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:38:36.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.294+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:36.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.305+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:38:36.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.327+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:38:36.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.333+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:38:36.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.333+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:38:36.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.348+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:38:36.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.356+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:38:36.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.364+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:38:36.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.374+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:38:36.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.414+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:38:36.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.415+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:38:36.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.415+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:38:36.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.422+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:38:36.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.466+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:38:36.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.470+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:38:36.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.478+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:38:36.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.497+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:38:36.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.509+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:38:36.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.512+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:38:36.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.552+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:38:36.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.552+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:38:36.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.566+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:36.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.593+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:38:36.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.597+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:38:36.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.615+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:38:36.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.617+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:38:36.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.624+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:38:36.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.632+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:38:36.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.632+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:38:36.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.660+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:36.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.661+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:38:36.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.691+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:38:36.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.707+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:38:36.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.714+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:38:36.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.722+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:38:36.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 133 16 1811852 1811836 851.351 858.188 0.00163398 0.00116383 2024-09-17T16:38:36.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.750+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:38:36.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.755+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:38:36.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.763+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:38:36.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.767+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:38:36.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.806+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:38:36.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.810+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:38:36.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.837+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:38:36.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.838+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:38:36.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.862+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:38:36.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:38:36.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.887+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:38:36.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.888+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:38:36.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.889+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:38:36.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.894+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:38:36.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.904+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:38:36.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.920+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:38:36.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.949+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:38:36.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.956+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:38:36.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.965+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:38:36.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.974+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:38:36.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.983+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:38:36.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:36.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:36.987+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:38:37.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.006+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:38:37.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.020+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:38:37.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.025+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:38:37.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.028+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:38:37.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.033+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:38:37.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.063+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:38:37.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.082+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:38:37.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.095+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:38:37.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.095+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:38:37.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.101+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:38:37.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.111+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:38:37.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:38:37.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.129+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:38:37.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.137+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:38:37.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.142+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:38:37.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.149+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:38:37.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.167+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:37.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.183+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:38:37.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.184+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:38:37.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.192+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:38:37.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.207+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:38:37.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.215+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:38:37.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.225+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:38:37.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.232+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:38:37.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.256+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:38:37.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.260+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:38:37.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.270+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:38:37.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.289+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:38:37.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.317+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:38:37.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.329+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:38:37.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.331+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:38:37.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.343+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:38:37.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.353+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:38:37.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.355+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:38:37.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.406+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:38:37.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.407+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:38:37.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.417+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:38:37.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.429+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:38:37.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.464+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:38:37.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.473+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:37.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.474+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:38:37.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.489+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:38:37.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.495+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:38:37.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.513+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:38:37.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.516+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:37.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.538+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:38:37.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.546+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:38:37.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.550+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:38:37.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.566+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:38:37.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.571+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:38:37.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:38:37.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.584+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:38:37.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.602+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:37.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.617+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:38:37.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.627+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:38:37.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.653+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:38:37.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:38:37.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.674+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:38:37.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.674+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:38:37.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.712+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:38:37.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.717+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:38:37.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.742+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:37.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.742+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:38:37.748 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 134 16 1825605 1825589 851.412 859.562 0.00112358 0.00116374 2024-09-17T16:38:37.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.749+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:38:37.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.760+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:38:37.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.772+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:38:37.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.783+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:38:37.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.791+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:38:37.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.801+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:38:37.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.834+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:38:37.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.840+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:38:37.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.846+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:38:37.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.847+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:38:37.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.867+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:38:37.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.876+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:38:37.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.882+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:38:37.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.897+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:38:37.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.916+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:38:37.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.941+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:38:37.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.946+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:38:37.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:38:37.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.967+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:38:37.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.988+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:38:38.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:37.998+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:38:38.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.015+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:38:38.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.019+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:38:38.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.029+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:38:38.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.038+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:38:38.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.043+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:38:38.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.047+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:38:38.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.063+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:38:38.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.077+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:38:38.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.078+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:38:38.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.092+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:38:38.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.128+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:38:38.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.144+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:38:38.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.152+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:38:38.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.169+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:38:38.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.177+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:38:38.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.179+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:38:38.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.188+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:38:38.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.198+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:38:38.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.231+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:38:38.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.236+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:38:38.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.254+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:38:38.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.260+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:38:38.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.273+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:38:38.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.292+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:38:38.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.293+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:38.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.299+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:38.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.303+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:38:38.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.334+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:38:38.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.334+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:38:38.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.347+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:38:38.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.376+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:38:38.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.408+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:38:38.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.416+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:38:38.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.423+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:38:38.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.424+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:38:38.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.424+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:38:38.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.432+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:38:38.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.460+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:38:38.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.471+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:38:38.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.497+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:38:38.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:38:38.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.513+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:38:38.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.519+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:38:38.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.532+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:38:38.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.544+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:38:38.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.557+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:38:38.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.565+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:38:38.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.590+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:38:38.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:38:38.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.623+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:38:38.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.623+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:38:38.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.635+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:38:38.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.659+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:38:38.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.659+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:38:38.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.673+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:38:38.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.679+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:38:38.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.680+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:38:38.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.696+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:38:38.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.704+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:38:38.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.705+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:38:38.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 135 16 1839469 1839453 851.523 866.5 0.000771095 0.00116359 2024-09-17T16:38:38.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.748+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:38:38.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.755+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:38.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.770+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:38:38.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.776+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:38:38.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.777+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:38:38.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.803+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:38.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.810+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:38:38.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.838+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:38:38.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.843+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:38:38.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.858+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:38:38.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.863+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:38:38.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.872+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:38:38.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.890+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:38:38.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.895+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:38:38.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.897+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:38.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.919+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:38:38.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.944+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:38:38.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.955+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:38:38.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.976+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:38:38.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.983+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:38:38.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:38.989+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:38:39.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.001+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:38:39.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.002+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:38:39.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.010+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:38:39.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.047+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:38:39.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.050+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:38:39.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.051+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:38:39.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.059+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:38:39.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.072+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:38:39.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.081+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:38:39.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.112+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:38:39.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.122+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:38:39.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.125+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:38:39.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.134+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:39.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.140+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:38:39.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.144+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:38:39.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.168+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:38:39.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.169+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:38:39.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.172+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:38:39.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.180+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:38:39.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.200+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:38:39.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.204+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:38:39.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.209+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:38:39.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.235+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:38:39.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.246+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:38:39.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.254+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:38:39.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.270+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:38:39.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.275+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:38:39.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.288+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:38:39.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.288+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:38:39.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.297+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:38:39.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.320+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:38:39.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.326+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:38:39.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.332+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:38:39.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.342+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:38:39.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.360+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:38:39.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.362+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:38:39.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.367+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:38:39.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.388+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:38:39.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.389+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:38:39.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.392+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:38:39.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:38:39.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.412+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:38:39.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.426+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:38:39.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:38:39.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.462+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:38:39.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.468+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:38:39.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.471+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:38:39.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.490+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:38:39.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.491+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:38:39.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.498+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:38:39.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:38:39.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.539+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:38:39.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.550+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:38:39.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.561+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:38:39.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.569+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:38:39.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.583+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:38:39.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.599+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:38:39.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.605+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:38:39.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.621+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:38:39.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.638+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:38:39.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.643+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:38:39.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.646+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:38:39.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.667+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:38:39.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.668+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:38:39.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.675+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:38:39.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.688+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:39.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.706+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:39.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.707+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:38:39.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.719+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:38:39.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.722+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:38:39.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.728+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:38:39.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 136 16 1853199 1853183 851.571 858.125 0.000948402 0.0011635 2024-09-17T16:38:39.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.752+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:38:39.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.758+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:38:39.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.780+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:38:39.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.791+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:38:39.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.797+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:38:39.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.822+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:38:39.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:38:39.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.862+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:38:39.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.863+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:38:39.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.878+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:38:39.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.886+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:38:39.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.889+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:39.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.903+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:38:39.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.906+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:38:39.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.920+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:39.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.931+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:38:39.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.953+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:38:39.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.957+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:38:39.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.968+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:38:39.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.968+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:38:39.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.982+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:38:39.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:39.995+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:38:40.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.026+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:38:40.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.031+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:38:40.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.045+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:38:40.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.051+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:38:40.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.077+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:38:40.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.083+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:38:40.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.088+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:38:40.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.098+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:38:40.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.107+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:38:40.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.120+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:40.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.127+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:38:40.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.134+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:38:40.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.134+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:38:40.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.146+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:38:40.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.147+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:38:40.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.169+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:38:40.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:40.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.195+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:38:40.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.199+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:38:40.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.215+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:38:40.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.230+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:38:40.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.244+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:38:40.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.342+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:38:40.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.346+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:38:40.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.364+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:38:40.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.380+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:38:40.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.404+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:38:40.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.405+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:38:40.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.412+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:38:40.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.441+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:38:40.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.459+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:38:40.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.482+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:38:40.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.483+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:38:40.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.491+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:38:40.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.511+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:38:40.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.516+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:38:40.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.519+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:38:40.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.536+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:38:40.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.544+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:38:40.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.549+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:38:40.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.564+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:38:40.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.570+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:38:40.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.596+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:38:40.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.596+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:38:40.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:38:40.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.632+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:38:40.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.658+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:38:40.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.663+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:38:40.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.670+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:38:40.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.684+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:38:40.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.692+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:38:40.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.693+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:38:40.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.723+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:40.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.731+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:38:40.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.735+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:38:40.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.740+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:38:40.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.740+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:38:40.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 137 15 1865821 1865806 851.113 788.938 0.000698173 0.00116414 2024-09-17T16:38:40.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.753+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:38:40.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.774+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:38:40.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.776+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:38:40.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.790+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:38:40.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.798+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:38:40.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:38:40.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.808+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:40.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.841+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:38:40.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.841+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:38:40.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.851+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:38:40.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.862+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:38:40.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.879+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:38:40.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.898+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:38:40.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.924+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:38:40.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.942+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:38:40.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:40.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.951+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:38:40.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.976+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:38:40.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.981+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:38:40.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.982+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:38:40.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.991+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:38:40.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.994+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:38:41.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:40.997+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:38:41.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.020+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:41.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.036+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:38:41.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.039+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:38:41.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.057+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:38:41.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.058+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:38:41.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.059+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:38:41.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.070+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:38:41.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.087+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:38:41.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.096+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:38:41.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.099+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:38:41.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.104+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:38:41.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.114+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:38:41.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.123+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:38:41.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.124+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:38:41.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.134+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:38:41.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.138+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:38:41.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.160+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:41.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.185+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:38:41.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.199+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:38:41.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.204+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:38:41.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.207+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:38:41.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.223+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:38:41.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.242+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:38:41.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.273+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:38:41.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.274+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:38:41.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.300+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:38:41.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.305+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:38:41.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.314+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:38:41.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.315+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:38:41.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.330+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:41.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.333+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:38:41.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.345+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:38:41.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.350+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:38:41.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.360+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:38:41.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.370+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:41.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.398+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:38:41.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.399+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:38:41.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.409+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:38:41.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.419+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:38:41.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.422+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:38:41.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.426+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:38:41.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.433+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:38:41.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.452+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:38:41.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.475+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:38:41.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.475+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:38:41.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.483+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:38:41.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.493+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:38:41.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.508+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:38:41.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.519+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:38:41.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.530+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:38:41.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.534+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:38:41.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.553+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:38:41.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.582+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:38:41.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.605+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:38:41.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.611+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:38:41.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.619+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:38:41.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:38:41.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.635+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:38:41.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:38:41.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:38:41.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.672+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:38:41.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.683+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:38:41.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.701+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:38:41.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.702+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:38:41.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.708+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:38:41.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.729+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:38:41.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 138 16 1879277 1879261 851.039 840.938 0.000914413 0.00116426 2024-09-17T16:38:41.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.750+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:38:41.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.762+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:38:41.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.762+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:38:41.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.784+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:38:41.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.793+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:41.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.799+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:38:41.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.806+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:38:41.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.820+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:38:41.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.821+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:38:41.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.845+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:38:41.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.862+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:38:41.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.866+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:38:41.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.870+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:38:41.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.909+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:38:41.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.920+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:38:41.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.924+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:38:41.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.935+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:38:41.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.935+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:38:41.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.945+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:38:41.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:38:41.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.987+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:38:41.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:41.991+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:38:42.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.005+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:38:42.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.009+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:38:42.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.015+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:38:42.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.018+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:38:42.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.030+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:38:42.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.073+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:38:42.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.101+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:42.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.103+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:38:42.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.104+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:38:42.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.106+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:38:42.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.132+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:38:42.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.138+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:38:42.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.153+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:38:42.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.155+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:38:42.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.166+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:38:42.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.168+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:38:42.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.186+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:38:42.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.189+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:38:42.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.199+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:38:42.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.212+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:38:42.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.218+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:38:42.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.257+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:38:42.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.261+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:38:42.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.264+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:38:42.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.277+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:38:42.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.291+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:38:42.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.317+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:38:42.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.319+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:38:42.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.320+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:38:42.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.324+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:38:42.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.338+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:42.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.354+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:38:42.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.365+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:38:42.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.405+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:38:42.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.421+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:38:42.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.429+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:38:42.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.437+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:38:42.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.446+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:38:42.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.467+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:38:42.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.468+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:38:42.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.481+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:38:42.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.503+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:38:42.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.505+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:38:42.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.514+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:38:42.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.523+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:38:42.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.526+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:42.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.539+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:38:42.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.553+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:38:42.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.558+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:38:42.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.563+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:38:42.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.588+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:38:42.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.607+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:38:42.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.613+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:38:42.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.616+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:38:42.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.641+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:38:42.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.652+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:38:42.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.652+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:38:42.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.662+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:38:42.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.698+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:42.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.707+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:38:42.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.718+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:38:42.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.719+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:38:42.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.721+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:38:42.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.732+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:38:42.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 139 16 1893098 1893082 851.13 863.812 0.000499308 0.00116411 2024-09-17T16:38:42.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.757+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:38:42.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.777+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:38:42.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.798+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:38:42.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.801+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:38:42.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.807+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:38:42.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:38:42.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.834+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:42.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.845+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:38:42.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:38:42.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.857+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:38:42.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.866+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:38:42.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.887+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:38:42.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.895+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:38:42.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.918+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:38:42.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.933+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:38:42.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.937+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:38:42.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.947+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:38:42.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.955+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:38:42.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.958+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:38:42.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.970+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:38:42.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.986+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:38:42.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.992+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:38:42.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:42.997+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:38:43.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.021+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:43.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.031+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:38:43.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.033+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:38:43.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:38:43.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.045+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:38:43.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.074+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:38:43.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.094+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:38:43.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.109+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:38:43.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.115+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:43.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.135+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:38:43.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.151+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:43.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.171+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:38:43.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.190+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:38:43.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.192+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:38:43.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.207+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:38:43.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.207+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:38:43.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.221+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:38:43.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.235+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:38:43.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.235+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:38:43.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.249+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:38:43.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.266+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:38:43.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.288+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:38:43.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.292+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:38:43.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:38:43.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.307+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:38:43.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.323+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:38:43.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.345+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:38:43.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.353+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:38:43.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.357+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:38:43.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.361+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:43.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.374+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:38:43.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.387+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:38:43.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.405+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:38:43.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.411+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:38:43.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.424+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:38:43.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.431+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:38:43.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.449+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:38:43.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.454+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:38:43.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.454+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:38:43.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.459+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:38:43.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.468+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:38:43.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.474+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:38:43.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.480+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:38:43.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.496+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:38:43.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.500+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:38:43.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.505+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:38:43.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.540+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:43.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.555+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:43.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.558+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:38:43.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.562+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:38:43.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.571+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:38:43.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.579+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:38:43.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.580+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:38:43.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.604+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:38:43.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.616+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:38:43.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.637+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:38:43.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.643+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:38:43.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.651+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:38:43.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.656+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:38:43.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.663+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:38:43.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.667+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:38:43.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.680+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:38:43.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.699+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:38:43.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:38:43.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.713+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:43.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.721+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:38:43.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.726+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:38:43.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.729+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:38:43.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.736+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:38:43.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:38:43.748230+0000 min lat: 0.000227768 max lat: 0.114701 avg lat: 0.00116394 2024-09-17T16:38:43.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:38:43.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 140 16 1906973 1906957 851.245 867.188 0.00214619 0.00116394 2024-09-17T16:38:43.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.747+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:43.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.767+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:38:43.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.781+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:38:43.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.792+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:38:43.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.808+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:38:43.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:38:43.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.814+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:38:43.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.829+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:38:43.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.856+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:38:43.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.862+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:38:43.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.869+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:43.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.892+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:38:43.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.909+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:43.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.917+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:38:43.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.923+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:38:43.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.929+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:38:43.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.932+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:38:43.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:38:43.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.952+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:38:43.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.977+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:38:43.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.989+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:38:43.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:43.997+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:38:44.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.002+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:38:44.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.024+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:38:44.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.028+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:38:44.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.038+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:38:44.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.076+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:38:44.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.083+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:38:44.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.093+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:44.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.103+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:38:44.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.124+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:38:44.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.137+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:38:44.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.138+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:38:44.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.141+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:38:44.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.152+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:38:44.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.160+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:38:44.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.168+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:38:44.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.193+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:38:44.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.206+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:38:44.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.207+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:38:44.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.211+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:38:44.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.213+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:38:44.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.230+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:38:44.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.246+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:38:44.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.247+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:38:44.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.265+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:38:44.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.279+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:38:44.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.294+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:38:44.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.307+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:38:44.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.307+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:38:44.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.320+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:38:44.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.330+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:38:44.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.340+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:38:44.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.346+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:44.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.352+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:38:44.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:38:44.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.376+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:38:44.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.391+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:38:44.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.396+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:44.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.407+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:38:44.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.418+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:38:44.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.444+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:44.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.451+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:38:44.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.472+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:38:44.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.488+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:38:44.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.499+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:38:44.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.501+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:38:44.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.532+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:38:44.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.532+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:38:44.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.542+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:38:44.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.550+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:38:44.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.558+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:38:44.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.581+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:38:44.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.592+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:38:44.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.596+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:38:44.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.603+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:38:44.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.612+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:38:44.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.615+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:38:44.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.629+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:38:44.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.658+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:38:44.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.660+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:38:44.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.670+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:38:44.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.680+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:38:44.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.694+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:38:44.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.708+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:38:44.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.712+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:38:44.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.714+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:38:44.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.717+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:38:44.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 141 15 1920998 1920983 851.424 876.625 0.000440159 0.00116369 2024-09-17T16:38:44.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.748+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:38:44.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.761+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:38:44.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.769+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:38:44.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.772+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:38:44.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.784+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:38:44.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.792+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:38:44.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.796+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:38:44.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.812+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:38:44.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.819+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:44.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.824+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:38:44.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.847+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:38:44.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.858+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:44.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.864+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:38:44.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:38:44.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.904+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:38:44.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.908+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:38:44.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.931+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:38:44.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.941+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:38:44.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.946+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:38:44.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.959+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:38:44.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.963+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:38:44.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.986+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:38:44.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.986+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:38:44.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:44.989+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:38:45.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.010+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:38:45.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.014+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:38:45.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.036+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:38:45.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.051+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:38:45.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.059+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:38:45.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.064+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:38:45.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.069+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:38:45.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.083+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:38:45.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.095+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:38:45.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.107+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:38:45.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.110+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:38:45.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.123+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:38:45.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.137+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:38:45.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.152+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:38:45.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.166+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:38:45.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.172+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:38:45.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.177+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:38:45.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.219+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:38:45.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.224+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:38:45.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.225+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:38:45.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.250+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:38:45.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.251+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:38:45.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.255+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:38:45.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.255+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:38:45.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.278+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:38:45.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.331+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:38:45.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.361+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:38:45.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.373+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:38:45.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.380+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:38:45.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.386+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:38:45.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.386+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:38:45.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.397+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:45.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.434+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:38:45.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.436+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:38:45.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.456+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:38:45.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.457+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:38:45.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.468+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:38:45.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.485+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:38:45.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.488+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:38:45.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.492+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:38:45.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.499+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:38:45.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.511+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:38:45.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.520+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:38:45.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:38:45.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.544+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:38:45.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.556+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:38:45.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.556+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:45.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.585+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:38:45.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.603+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:38:45.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.619+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:38:45.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.628+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:38:45.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.634+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:38:45.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.636+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:38:45.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.639+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:38:45.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:38:45.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.668+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:38:45.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.672+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:38:45.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.694+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:38:45.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.701+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:38:45.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.708+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:45.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.709+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:38:45.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.734+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:38:45.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 142 16 1934235 1934219 851.253 827.25 0.000654081 0.00116396 2024-09-17T16:38:45.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.756+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:38:45.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.764+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:38:45.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.799+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:38:45.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.804+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:38:45.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.813+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:38:45.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.825+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:38:45.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.836+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:38:45.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.854+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:38:45.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.863+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:38:45.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.872+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:38:45.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.886+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:38:45.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.939+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:38:45.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.970+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:38:45.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.975+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:38:45.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.976+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:38:45.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.992+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:38:45.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:45.995+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:38:46.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.031+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:38:46.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.034+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:46.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:38:46.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.058+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:38:46.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.073+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:46.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.085+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:38:46.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.089+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:38:46.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.100+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:38:46.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.109+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:38:46.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.130+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:38:46.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.131+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:38:46.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.171+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:38:46.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.171+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:38:46.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.174+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:38:46.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.203+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:38:46.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.228+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:38:46.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.236+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:38:46.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.251+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:38:46.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.253+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:38:46.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.265+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:38:46.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.267+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:38:46.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.270+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:38:46.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.273+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:38:46.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.405+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:38:46.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.420+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:38:46.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.428+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:38:46.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.448+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:38:46.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.457+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:38:46.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.471+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:38:46.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.478+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:38:46.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.503+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:38:46.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.504+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:38:46.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:38:46.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.523+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:38:46.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.527+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:38:46.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.533+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:38:46.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.548+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:38:46.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.580+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:46.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.583+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:46.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.607+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:38:46.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.609+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:38:46.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.624+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:38:46.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.637+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:38:46.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:46.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.670+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:38:46.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.692+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:38:46.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.696+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:38:46.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.700+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:46.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.718+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:38:46.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.722+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:38:46.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.729+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:38:46.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.746+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:38:46.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 143 15 1946684 1946669 850.741 778.125 0.000943517 0.00116466 2024-09-17T16:38:46.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.748+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:38:46.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.756+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:38:46.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.775+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:38:46.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.785+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:38:46.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.789+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:38:46.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.818+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:38:46.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.823+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:38:46.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.834+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:38:46.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.858+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:38:46.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.861+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:38:46.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.869+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:38:46.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.898+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:46.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.898+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:38:46.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:38:46.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:38:46.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.935+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:38:46.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.937+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:38:46.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.939+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:38:46.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.962+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:38:46.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.965+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:38:46.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.968+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:38:46.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.989+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:38:46.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:46.993+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:38:47.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.008+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:38:47.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.012+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:38:47.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.017+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:38:47.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.025+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:38:47.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.057+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:38:47.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.071+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:38:47.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.073+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:38:47.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.081+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:38:47.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.086+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:38:47.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.132+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:38:47.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.145+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:38:47.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.158+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:38:47.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.185+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:38:47.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.197+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:38:47.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.202+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:47.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:38:47.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.216+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:38:47.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.219+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:38:47.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.240+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:38:47.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.246+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:38:47.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.253+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:38:47.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.269+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:38:47.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.274+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:38:47.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.283+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:47.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.292+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:38:47.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.300+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:38:47.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.322+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:38:47.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.322+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:38:47.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.325+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:47.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.334+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:38:47.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.340+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:38:47.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.358+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:38:47.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.368+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:47.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.398+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:38:47.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.401+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:38:47.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.402+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:38:47.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.411+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:38:47.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.412+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:38:47.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.414+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:38:47.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.427+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:38:47.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.435+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:38:47.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.456+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:38:47.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.494+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:38:47.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.512+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:38:47.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.520+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:38:47.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.537+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:38:47.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.545+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:38:47.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.551+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:38:47.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.556+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:38:47.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.575+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:38:47.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.585+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:38:47.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.591+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:38:47.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.593+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:38:47.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:38:47.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.597+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:38:47.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.614+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:38:47.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.638+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:38:47.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.671+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:38:47.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.685+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:47.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.689+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:38:47.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.689+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:38:47.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.695+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:38:47.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.722+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:38:47.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.722+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:38:47.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.723+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:38:47.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.739+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:38:47.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.745+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:38:47.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 144 16 1960202 1960186 850.699 844.812 0.000735502 0.00116469 2024-09-17T16:38:47.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.762+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:38:47.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.768+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:38:47.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.775+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:38:47.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.792+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:38:47.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.810+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:38:47.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.812+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:38:47.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.824+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:38:47.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.836+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:38:47.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.855+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:38:47.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.880+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:38:47.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.883+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:38:47.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.888+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:38:47.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.893+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:38:47.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:38:47.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.913+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:38:47.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.934+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:38:47.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.944+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:38:47.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.959+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:38:47.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.980+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:38:47.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:47.988+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:38:48.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.004+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:38:48.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.017+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:38:48.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.020+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:38:48.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.044+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:38:48.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.067+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:38:48.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.069+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:38:48.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.071+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:38:48.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.090+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:38:48.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.092+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:38:48.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.119+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:38:48.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.135+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:38:48.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.146+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:38:48.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.152+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:38:48.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.152+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:38:48.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.184+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:48.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.210+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:38:48.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.213+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:38:48.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.215+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:38:48.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.219+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:38:48.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.251+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:38:48.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.267+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:38:48.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.279+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:38:48.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.288+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:38:48.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.292+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:38:48.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.294+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:48.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.321+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:38:48.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.334+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:38:48.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.339+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:38:48.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.357+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:38:48.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.360+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:38:48.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.365+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:38:48.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.374+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:38:48.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.379+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:38:48.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.384+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:38:48.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.404+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:38:48.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.432+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:38:48.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.434+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:38:48.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.440+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:38:48.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.453+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:38:48.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.459+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:38:48.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.469+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:38:48.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.476+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:38:48.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.513+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:38:48.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.523+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:38:48.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.532+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:38:48.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.539+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:38:48.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.543+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:38:48.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.570+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:38:48.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.590+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:48.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.609+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:38:48.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.622+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:38:48.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.637+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:38:48.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.644+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:38:48.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.655+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:38:48.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.685+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:38:48.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.709+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:38:48.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.710+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:48.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.721+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:38:48.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.726+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:38:48.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.730+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:48.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 145 16 1974079 1974063 850.814 867.312 0.00331773 0.00116456 2024-09-17T16:38:48.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.754+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:38:48.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.757+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:38:48.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.760+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:38:48.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.768+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:38:48.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.787+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:38:48.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.798+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:38:48.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.819+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:38:48.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.826+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:38:48.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.831+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:38:48.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.834+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:38:48.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.852+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:38:48.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.860+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:38:48.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.898+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:38:48.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.910+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:38:48.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.916+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:38:48.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.917+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:38:48.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.923+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:38:48.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:48.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.956+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:38:48.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.958+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:38:48.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.970+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:38:48.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:48.977+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:49.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:38:49.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.017+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:38:49.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.033+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:38:49.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.034+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:38:49.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.060+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:49.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.064+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:38:49.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.075+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:38:49.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:38:49.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.103+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:38:49.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.120+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:38:49.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.129+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:38:49.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.132+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:38:49.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.155+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:38:49.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.156+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:38:49.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.184+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:38:49.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.193+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:38:49.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.196+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:38:49.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.202+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:38:49.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.208+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:38:49.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.218+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:38:49.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.231+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:38:49.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.246+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:38:49.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.256+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:38:49.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:38:49.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.293+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:38:49.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.302+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:38:49.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.308+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:38:49.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.313+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:49.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.332+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:38:49.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.341+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:38:49.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.341+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:38:49.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.363+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:38:49.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.364+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:38:49.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.395+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:38:49.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.399+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:38:49.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.401+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:38:49.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.430+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:38:49.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.441+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:38:49.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.442+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:38:49.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.461+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.463+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.468+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.482+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.494+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.504+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.513+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:38:49.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.539+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:38:49.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.562+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:38:49.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.565+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:38:49.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.572+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:38:49.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.592+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:49.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.594+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:38:49.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.626+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:38:49.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.628+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:38:49.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.654+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:38:49.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.660+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:38:49.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.673+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:38:49.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.703+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:38:49.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.720+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:38:49.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.727+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:38:49.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.735+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:38:49.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.738+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:38:49.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.740+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:38:49.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.741+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:38:49.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.744+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:38:49.749 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 146 16 1987874 1987858 850.891 862.188 0.000598342 0.00116444 2024-09-17T16:38:49.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.779+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:38:49.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.789+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:38:49.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.802+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:38:49.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.818+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:38:49.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.832+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:38:49.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.836+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:38:49.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.854+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:38:49.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:38:49.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.859+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:38:49.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.866+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:38:49.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.889+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:38:49.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.893+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:49.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.906+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:38:49.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.937+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:38:49.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.956+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:38:49.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.959+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:38:49.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.967+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:38:49.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.970+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:38:49.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.986+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:38:49.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:49.995+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:38:50.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.011+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:38:50.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.019+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:50.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.031+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:38:50.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.036+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:38:50.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.047+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:38:50.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.058+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:38:50.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.058+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:38:50.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.076+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:38:50.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.082+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:38:50.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:38:50.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.108+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:38:50.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.113+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:38:50.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.138+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:38:50.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.139+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:38:50.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.144+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:38:50.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.157+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:38:50.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.176+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:38:50.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.194+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:38:50.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.203+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:38:50.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:38:50.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.217+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:38:50.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.219+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:38:50.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.235+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:38:50.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.250+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:50.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.256+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:38:50.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.262+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:38:50.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.263+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:38:50.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.282+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:38:50.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.283+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:38:50.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:38:50.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.314+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:38:50.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.318+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:38:50.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.338+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:38:50.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.346+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:38:50.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.360+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:38:50.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.361+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:38:50.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.372+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:38:50.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.373+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:38:50.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.381+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:38:50.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.387+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:38:50.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.419+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:38:50.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.421+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:38:50.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.445+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:38:50.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.447+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:38:50.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.448+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:50.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.458+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:38:50.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.464+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:38:50.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.466+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:38:50.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.492+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:38:50.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.501+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:38:50.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.512+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:38:50.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.518+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:38:50.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.523+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:38:50.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.548+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:38:50.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.561+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:38:50.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:38:50.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.585+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:38:50.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.596+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:38:50.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.605+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:38:50.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.609+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:38:50.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.638+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:38:50.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.652+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:38:50.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:38:50.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.668+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:38:50.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.669+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:38:50.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.679+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:38:50.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.701+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:38:50.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:38:50.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.728+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:38:50.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.734+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:50.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 147 16 2001023 2001007 850.693 821.812 0.00364169 0.00116473 2024-09-17T16:38:50.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.749+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:38:50.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.755+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:38:50.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.781+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:38:50.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.796+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:38:50.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.803+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:38:50.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.803+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:38:50.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.813+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:38:50.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.826+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:38:50.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.828+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:38:50.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.830+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:38:50.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.870+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:38:50.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.871+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:38:50.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:50.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.896+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:38:50.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.906+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:38:50.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.910+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:38:50.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.913+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:38:50.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.929+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:38:50.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.942+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:38:50.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.955+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:38:50.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.968+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:38:50.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.971+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:38:50.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.982+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:38:50.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:50.989+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:38:51.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.005+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:38:51.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.009+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:38:51.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.034+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:38:51.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.042+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:38:51.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.043+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:38:51.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.052+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:38:51.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.058+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:38:51.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.069+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:38:51.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:51.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.099+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:38:51.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.107+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:38:51.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.107+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:38:51.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.131+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:38:51.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.137+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:38:51.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.164+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:38:51.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.166+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:38:51.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.190+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:38:51.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.195+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:38:51.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.203+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:38:51.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.209+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:38:51.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.226+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:38:51.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.228+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:38:51.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:38:51.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.248+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:38:51.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.263+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:38:51.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.278+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:38:51.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.289+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:38:51.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.292+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:38:51.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.303+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:38:51.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.303+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:38:51.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.330+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:38:51.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.383+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:38:51.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.404+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:38:51.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.426+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:38:51.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.427+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:38:51.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.432+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:38:51.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.444+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:38:51.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.456+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:38:51.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.457+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:38:51.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.475+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:38:51.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.491+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:38:51.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.511+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:38:51.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.514+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:38:51.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.532+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:38:51.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.539+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:38:51.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.539+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:38:51.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.552+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:38:51.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:38:51.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.573+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:38:51.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.586+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:38:51.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.586+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:38:51.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.598+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:38:51.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.602+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:38:51.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.609+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:38:51.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.641+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:38:51.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.701+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:38:51.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.740+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:38:51.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.742+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:38:51.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 148 16 2014412 2014396 850.598 836.812 0.000658662 0.00116486 2024-09-17T16:38:51.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.756+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:38:51.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.774+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:38:51.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.791+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:38:51.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.794+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:38:51.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.803+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:38:51.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.811+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:51.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.828+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:38:51.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.867+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:38:51.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.873+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:38:51.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.882+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:38:51.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.890+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:38:51.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.891+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:38:51.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.896+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:38:51.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.918+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:38:51.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.932+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:38:51.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.937+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:38:51.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.938+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:38:51.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.961+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:38:51.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:38:51.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.967+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:38:51.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.975+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:38:51.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:51.990+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:38:52.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.025+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:38:52.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.039+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:38:52.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.063+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:38:52.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.065+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:38:52.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.084+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:38:52.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.094+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:38:52.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.097+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:38:52.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.108+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:38:52.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.127+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:38:52.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.134+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:38:52.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.151+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:38:52.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.159+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:38:52.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.184+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:38:52.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.186+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:38:52.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.190+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:38:52.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.197+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:38:52.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.204+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:38:52.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:38:52.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.234+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:38:52.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.245+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:38:52.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.254+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:38:52.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.264+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:38:52.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.269+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:38:52.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.276+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:38:52.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.285+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:38:52.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.316+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:38:52.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.336+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:38:52.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.359+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:38:52.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.360+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:38:52.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.368+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:38:52.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.377+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:38:52.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.410+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:38:52.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.413+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:38:52.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.428+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:38:52.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.429+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:38:52.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.438+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:38:52.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:38:52.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.460+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:38:52.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.461+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:38:52.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.463+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:38:52.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.469+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:38:52.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.475+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:38:52.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.525+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:38:52.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.528+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:38:52.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.534+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:38:52.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.546+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:38:52.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.557+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:38:52.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.563+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:38:52.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.582+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:52.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.588+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:38:52.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.617+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:38:52.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.620+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:38:52.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.643+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:52.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:38:52.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.662+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:38:52.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.662+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:52.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.677+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:38:52.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.702+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:52.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.709+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:38:52.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.737+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:38:52.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 149 16 2027961 2027945 850.573 846.812 0.000714957 0.0011649 2024-09-17T16:38:52.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.751+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:38:52.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.753+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:38:52.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.760+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:38:52.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.769+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:38:52.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.775+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:38:52.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.794+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:38:52.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.795+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:38:52.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.798+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:38:52.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.827+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:38:52.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.829+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:38:52.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.835+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:38:52.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.848+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:38:52.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.852+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:38:52.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.865+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:38:52.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.874+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:38:52.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:38:52.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.901+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:38:52.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.918+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:38:52.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.924+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:38:52.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.927+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:38:52.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.947+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:38:52.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.954+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:38:52.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.960+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:38:52.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.965+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:38:52.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:52.972+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:38:53.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.004+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:38:53.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.013+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:38:53.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.014+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:38:53.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.035+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:38:53.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.039+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:38:53.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.040+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:38:53.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.054+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:38:53.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.057+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:38:53.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.091+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:38:53.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.095+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:38:53.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.106+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:38:53.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.109+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:53.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.114+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:38:53.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.127+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:38:53.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:38:53.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.156+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:38:53.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.158+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:38:53.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:38:53.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.177+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:38:53.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.190+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:38:53.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.196+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:38:53.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.213+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:38:53.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.215+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:38:53.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.220+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:38:53.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.254+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:38:53.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.276+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:38:53.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.284+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:38:53.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.290+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:38:53.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.293+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:38:53.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.308+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:38:53.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.323+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:38:53.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.323+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:38:53.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.327+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:38:53.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.334+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:38:53.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.367+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:38:53.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.373+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:38:53.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.379+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:38:53.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:38:53.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.408+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:38:53.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.414+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:38:53.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.422+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:38:53.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.425+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:38:53.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.446+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:53.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.452+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:38:53.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.464+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:38:53.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.464+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:38:53.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.501+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:38:53.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.501+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:38:53.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.516+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:38:53.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.527+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:38:53.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:38:53.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.553+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:38:53.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.553+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:38:53.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.555+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:38:53.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.574+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:38:53.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.586+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:38:53.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.591+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:38:53.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.603+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:38:53.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.604+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:38:53.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.639+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:38:53.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:38:53.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.667+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:38:53.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.679+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:38:53.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.684+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:38:53.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.689+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:38:53.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.704+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:38:53.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.715+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:38:53.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.727+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:38:53.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.744+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:38:53.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.747+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:38:53.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 150 16 2041174 2041158 850.407 825.812 0.000797328 0.00116513 2024-09-17T16:38:53.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.750+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:38:53.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.751+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:53.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.787+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:38:53.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.794+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:38:53.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.808+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:38:53.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.822+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:38:53.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.848+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:38:53.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.859+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:38:53.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.873+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:38:53.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.882+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:38:53.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.888+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:38:53.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.892+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:38:53.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.904+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:38:53.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.915+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:38:53.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.946+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:38:53.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.949+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:38:53.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.959+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:38:53.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.975+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:38:53.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.979+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:38:53.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:53.980+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:38:54.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.007+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:38:54.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.018+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:38:54.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.028+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:38:54.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.036+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:38:54.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.047+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:38:54.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.065+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:38:54.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:38:54.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.119+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:38:54.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.133+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:38:54.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.142+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:38:54.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.143+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:38:54.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.155+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:38:54.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.169+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:38:54.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.182+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:38:54.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.209+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:38:54.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.232+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:38:54.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.239+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:38:54.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.247+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:38:54.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.257+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:38:54.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.259+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:38:54.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.269+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:38:54.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.304+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:38:54.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.307+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:38:54.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:54.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.328+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:38:54.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.338+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:38:54.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.344+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:38:54.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.348+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:38:54.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.365+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:38:54.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.366+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:38:54.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.391+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:38:54.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.398+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:38:54.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.402+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:38:54.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:38:54.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.416+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:38:54.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.418+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:38:54.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.447+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:38:54.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.462+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:38:54.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.487+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:38:54.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.507+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:38:54.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.508+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:38:54.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.509+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:38:54.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.530+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:38:54.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.560+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:38:54.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.563+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:38:54.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.578+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:38:54.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.593+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:38:54.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.617+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:38:54.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.632+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:38:54.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:38:54.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:38:54.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.660+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:38:54.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.679+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:38:54.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.688+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:38:54.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.697+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:38:54.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.712+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:38:54.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.725+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:38:54.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.743+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:38:54.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.747+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:38:54.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 151 16 2055257 2055241 850.604 880.188 0.000639599 0.00116486 2024-09-17T16:38:54.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.764+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:38:54.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.778+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:38:54.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.792+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:38:54.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.800+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:38:54.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.810+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:38:54.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.832+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:38:54.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.837+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:38:54.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.838+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:38:54.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.850+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:38:54.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.853+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:38:54.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.874+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:38:54.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.890+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:38:54.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.894+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:38:54.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.923+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:38:54.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.942+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:38:54.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.944+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:38:54.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.977+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:38:54.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.982+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:38:54.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:54.993+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:38:55.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.000+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:38:55.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.021+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:38:55.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.030+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:38:55.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.044+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:38:55.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.071+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:38:55.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.084+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:38:55.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.086+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:38:55.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.092+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:38:55.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.093+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:38:55.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.099+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:38:55.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.115+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:38:55.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.141+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:38:55.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.145+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:38:55.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.152+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:38:55.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.163+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:55.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.166+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:38:55.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.167+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:38:55.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.207+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:38:55.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.226+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:38:55.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.226+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:38:55.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.228+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:38:55.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.308+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:38:55.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.314+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:38:55.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.345+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:38:55.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.346+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:38:55.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.382+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:38:55.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.387+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:38:55.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.394+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:38:55.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.407+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:38:55.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.416+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:55.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.420+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:38:55.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.426+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:38:55.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.426+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:38:55.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.434+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:38:55.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.437+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:38:55.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.465+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:38:55.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.482+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:38:55.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.491+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:38:55.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.507+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:38:55.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.525+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:38:55.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.536+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:38:55.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.544+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:38:55.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.545+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:38:55.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.560+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:38:55.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.569+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:38:55.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.594+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:38:55.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.605+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:38:55.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.613+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:38:55.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.614+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:38:55.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.627+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:38:55.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.632+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:38:55.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.649+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:38:55.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.653+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:38:55.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.667+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:38:55.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.698+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:38:55.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.721+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:38:55.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.723+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:38:55.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.727+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:38:55.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.728+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:38:55.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 152 16 2068056 2068040 850.27 799.938 0.000686691 0.0011653 2024-09-17T16:38:55.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.755+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:38:55.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.777+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:38:55.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.785+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:38:55.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.791+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:38:55.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.793+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:38:55.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:55.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:38:55.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.827+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:38:55.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.833+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:38:55.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.838+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:38:55.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.858+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:38:55.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.864+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:38:55.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.884+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:38:55.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.893+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:38:55.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.912+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:38:55.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.920+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:55.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.931+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:38:55.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.959+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:38:55.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.966+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:38:55.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.973+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:38:55.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.986+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:38:55.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:55.996+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:38:56.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.011+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:38:56.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.017+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:38:56.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.026+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:38:56.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.032+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:38:56.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.038+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:38:56.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:38:56.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.071+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:38:56.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.080+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:38:56.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.083+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:38:56.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.099+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:38:56.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.100+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:38:56.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.110+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:38:56.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.127+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:56.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.131+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:38:56.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.161+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:38:56.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.173+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:38:56.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.186+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:38:56.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.195+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:38:56.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.198+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:38:56.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.212+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:38:56.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.215+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:38:56.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.229+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:38:56.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.242+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:38:56.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.252+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:38:56.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.267+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:38:56.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.268+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:38:56.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.283+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:38:56.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.284+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:38:56.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.305+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:38:56.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.342+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:38:56.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.348+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:38:56.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.352+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:38:56.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.369+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:38:56.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.382+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:38:56.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.384+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:38:56.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.396+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:38:56.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.405+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:38:56.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.423+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:38:56.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.437+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:38:56.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.454+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:38:56.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.472+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:38:56.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.474+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:38:56.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.493+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:38:56.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.500+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:38:56.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.501+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:38:56.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.510+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:38:56.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.554+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:38:56.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.565+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:38:56.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.579+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:38:56.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.583+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:38:56.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.588+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:38:56.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.596+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:38:56.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.597+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:38:56.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.604+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:38:56.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.646+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:38:56.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.647+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:38:56.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.649+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:38:56.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.676+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:38:56.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.679+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:38:56.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.683+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:38:56.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.686+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:38:56.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.697+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:38:56.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.717+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:38:56.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.736+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:38:56.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.740+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:38:56.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.745+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:38:56.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 153 15 2081809 2081794 850.331 859.625 0.00068318 0.00116523 2024-09-17T16:38:56.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.753+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:38:56.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.764+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:38:56.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.775+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:38:56.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.795+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:38:56.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.806+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:38:56.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.815+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:38:56.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.831+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:38:56.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.838+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:38:56.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.844+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:38:56.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.849+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:38:56.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.855+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:38:56.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.883+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:38:56.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.898+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:38:56.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.907+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:38:56.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.907+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:38:56.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.915+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:38:56.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.933+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:38:56.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.943+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:38:56.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.950+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:38:56.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.958+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:38:56.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.961+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:38:56.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.986+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:38:56.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.987+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:38:56.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.992+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:38:56.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:56.993+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:38:57.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.036+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:38:57.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.047+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:38:57.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.052+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:38:57.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.060+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:38:57.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.075+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:38:57.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.082+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:38:57.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.084+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:38:57.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.104+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:38:57.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.107+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:38:57.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.118+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:38:57.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.118+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:38:57.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.144+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:38:57.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.149+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:38:57.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.152+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:38:57.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.176+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:38:57.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.188+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:38:57.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.208+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:38:57.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.217+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:38:57.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.228+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:38:57.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.231+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:38:57.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.241+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:38:57.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.257+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:38:57.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:38:57.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.293+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:38:57.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.294+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:38:57.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.323+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:38:57.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.329+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:38:57.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:38:57.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.340+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:38:57.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.341+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:57.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.357+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:38:57.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.357+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:38:57.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.395+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:38:57.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.408+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:38:57.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.417+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:38:57.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.420+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:38:57.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.427+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:38:57.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.428+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:38:57.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.441+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:38:57.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.466+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:38:57.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.469+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:38:57.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.501+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:38:57.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.504+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:38:57.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.516+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:38:57.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.538+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:38:57.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.538+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:38:57.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.553+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:38:57.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.554+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:38:57.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.555+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:38:57.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.591+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:38:57.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.614+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:38:57.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.614+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:38:57.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.626+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:38:57.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.638+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:38:57.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.643+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:38:57.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.653+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:38:57.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.666+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:38:57.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.667+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:38:57.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.680+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:38:57.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.704+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:38:57.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.715+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:38:57.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.721+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:38:57.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.726+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:38:57.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.736+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:38:57.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.737+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:38:57.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 154 16 2095358 2095342 850.307 846.75 0.000723454 0.00116525 2024-09-17T16:38:57.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.756+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:38:57.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.778+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:38:57.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.784+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:38:57.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.797+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:38:57.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.810+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:38:57.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.816+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:38:57.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.824+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:38:57.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.831+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:38:57.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.850+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:38:57.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.856+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:38:57.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.856+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:57.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.873+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:38:57.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.880+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:38:57.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.891+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:38:57.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.895+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:38:57.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.897+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:38:57.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.899+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:38:57.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.912+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:38:57.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:38:57.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:38:57.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.972+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:38:57.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.975+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:38:57.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:57.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:38:58.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.000+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:38:58.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.000+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:38:58.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.005+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:38:58.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.023+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:38:58.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.054+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:38:58.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.071+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:38:58.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.073+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:38:58.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.073+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:38:58.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.080+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:38:58.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.093+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:38:58.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.105+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:38:58.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.112+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:38:58.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.113+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:38:58.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.123+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:38:58.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.133+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:38:58.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.164+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:38:58.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.169+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:38:58.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.178+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:38:58.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.187+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:38:58.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:38:58.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.204+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:38:58.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.236+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:38:58.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.245+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:38:58.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.268+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:38:58.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.285+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:38:58.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.293+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:38:58.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:38:58.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.302+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:38:58.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.314+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:38:58.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.325+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:38:58.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.333+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:38:58.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.346+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:38:58.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.349+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:38:58.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.359+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:38:58.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.379+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:38:58.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.383+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:38:58.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.403+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:38:58.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.406+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:38:58.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.409+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:38:58.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.468+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:38:58.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.476+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:38:58.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.492+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:38:58.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.498+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:38:58.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.508+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:38:58.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.512+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:38:58.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.521+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:38:58.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.526+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:38:58.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.548+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:38:58.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.550+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:38:58.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.580+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:38:58.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.584+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:38:58.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.612+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:38:58.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.614+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:38:58.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.642+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:38:58.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:38:58.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.650+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:38:58.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.669+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:38:58.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.675+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:38:58.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.699+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:38:58.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.702+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:38:58.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.719+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:38:58.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.719+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:38:58.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.722+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:38:58.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 155 16 2109158 2109142 850.385 862.5 0.000961093 0.00116516 2024-09-17T16:38:58.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.755+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:58.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.787+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:38:58.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.791+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:38:58.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.799+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:38:58.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.818+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:38:58.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.820+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:38:58.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.849+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:38:58.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.850+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:38:58.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.852+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:38:58.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.852+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:38:58.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.855+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:38:58.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.865+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:38:58.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.885+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:38:58.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.907+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:38:58.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.921+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:38:58.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.925+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:38:58.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.962+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:38:58.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:38:58.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.962+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:38:58.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:58.964+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:38:59.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.000+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:38:59.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.006+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:38:59.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.015+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:38:59.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.025+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:38:59.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.035+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:38:59.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.044+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:38:59.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.050+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:38:59.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.058+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:38:59.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.059+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:38:59.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:38:59.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:38:59.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.119+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:38:59.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.120+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:38:59.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.146+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:38:59.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.177+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:38:59.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.181+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:38:59.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.182+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:38:59.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:38:59.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.216+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:38:59.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.231+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:38:59.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.237+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:38:59.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.256+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:38:59.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.260+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:38:59.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.270+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:38:59.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.279+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:38:59.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.304+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:38:59.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.314+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:38:59.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.316+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:38:59.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.340+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:38:59.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.342+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:38:59.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.358+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:38:59.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.392+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:38:59.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.395+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:38:59.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.405+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:38:59.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.410+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:38:59.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.418+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:38:59.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.443+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:38:59.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.446+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:38:59.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.467+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:38:59.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.467+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:38:59.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.474+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:38:59.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.495+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:38:59.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.496+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:38:59.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.521+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:38:59.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.522+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:38:59.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.531+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:38:59.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.545+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:38:59.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.547+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:38:59.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.554+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:38:59.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.577+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:38:59.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.584+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:38:59.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:38:59.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.600+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:38:59.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.607+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:38:59.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.614+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:38:59.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.641+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:38:59.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.654+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:38:59.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.659+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:38:59.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.674+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:38:59.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.697+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:38:59.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.698+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:38:59.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.700+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:38:59.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.719+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:38:59.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.732+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:38:59.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.738+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:38:59.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 156 16 2123236 2123220 850.573 879.875 0.000814522 0.0011649 2024-09-17T16:38:59.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.759+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:38:59.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.761+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:38:59.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.804+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:38:59.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.819+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:38:59.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.827+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:38:59.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.841+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:38:59.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.858+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:38:59.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.859+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:38:59.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.866+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:38:59.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.908+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:38:59.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.909+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:38:59.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.930+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:38:59.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.933+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:38:59.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.946+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:38:59.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.947+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:38:59.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.954+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:38:59.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.957+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:38:59.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:38:59.990+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:39:00.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.010+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:39:00.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.015+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:39:00.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.035+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:39:00.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.054+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:39:00.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.069+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:39:00.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.075+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:39:00.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.079+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:39:00.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.094+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:39:00.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.107+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:39:00.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.123+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:39:00.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.135+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:00.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.138+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:00.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.145+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:39:00.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.146+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:39:00.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.152+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:39:00.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.186+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:39:00.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.191+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:39:00.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.200+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:39:00.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.210+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:39:00.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.210+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:39:00.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.211+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:39:00.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.223+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:39:00.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.229+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:39:00.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.268+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:39:00.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.272+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:39:00.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.275+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:39:00.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.286+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:39:00.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.287+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:39:00.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.298+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:39:00.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.430+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:39:00.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.440+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:39:00.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.442+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:39:00.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.447+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:39:00.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.457+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:39:00.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.469+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:39:00.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.487+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:39:00.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.500+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:39:00.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.511+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:39:00.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.530+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:39:00.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.531+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:00.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.554+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:00.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.569+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:00.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.574+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:39:00.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.579+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:39:00.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.588+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:39:00.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:39:00.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.617+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:39:00.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.617+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:39:00.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.618+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:39:00.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.656+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:39:00.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.672+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:39:00.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.695+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:39:00.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.697+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:39:00.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.698+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:00.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.698+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:39:00.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.717+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:00.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.728+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:39:00.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.741+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:00.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.743+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:39:00.750 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 157 16 2135842 2135826 850.173 787.875 0.000489329 0.00116543 2024-09-17T16:39:00.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.766+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:39:00.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.787+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:39:00.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.796+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:39:00.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.815+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:39:00.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.817+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:39:00.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.848+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:39:00.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.866+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:39:00.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.867+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:39:00.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.901+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:39:00.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.916+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:39:00.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.929+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:00.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.942+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:39:00.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.949+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:00.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.958+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:39:00.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.973+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:00.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.974+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:39:00.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.989+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:39:01.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:00.999+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:39:01.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.018+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:39:01.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.022+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:39:01.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.030+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:39:01.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.042+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:01.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.053+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:39:01.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.056+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:39:01.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.058+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:39:01.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.088+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:39:01.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.100+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:39:01.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.120+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:39:01.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.121+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:39:01.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.139+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:39:01.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.154+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:39:01.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.156+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:39:01.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.174+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:39:01.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.193+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:39:01.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.193+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:39:01.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.199+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:39:01.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.223+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:39:01.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.237+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:39:01.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.241+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:39:01.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.241+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:01.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.270+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:39:01.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.280+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:39:01.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.289+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:39:01.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.289+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:39:01.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.300+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:39:01.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.308+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:39:01.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.312+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:39:01.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.315+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:39:01.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.355+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:39:01.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.361+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:39:01.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.449+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:39:01.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.450+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:39:01.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.454+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:39:01.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.468+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:39:01.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.488+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:39:01.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.499+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:39:01.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.503+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:39:01.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.507+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:01.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.516+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:39:01.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.538+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:39:01.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:39:01.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.562+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:39:01.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.562+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:39:01.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.578+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:39:01.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.590+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:39:01.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.599+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:39:01.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.626+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:39:01.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.651+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:39:01.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.661+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:39:01.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.663+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:39:01.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.678+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:39:01.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.683+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:39:01.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.694+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:39:01.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.696+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:39:01.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.712+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:39:01.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.730+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:01.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.738+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:39:01.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.738+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:39:01.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 158 16 2149205 2149189 850.078 835.188 0.000989039 0.00116558 2024-09-17T16:39:01.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.752+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:39:01.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.771+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:39:01.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.779+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:39:01.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.779+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:39:01.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.794+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:39:01.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.846+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:39:01.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.849+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:39:01.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.861+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:39:01.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.866+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:39:01.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.898+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:39:01.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.920+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:39:01.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.925+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:39:01.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.959+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:39:01.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.959+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:39:01.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.971+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:01.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.981+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:39:01.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.985+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:39:01.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:01.996+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:39:02.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.012+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:39:02.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.033+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:39:02.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.034+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:39:02.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.041+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:39:02.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.041+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:39:02.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.050+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:39:02.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.084+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:02.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.100+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:39:02.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.112+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:02.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.114+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:39:02.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.115+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:39:02.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.122+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:39:02.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.131+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:39:02.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.158+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:39:02.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.162+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:39:02.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.197+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:39:02.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.203+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:39:02.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.222+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:39:02.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.230+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:39:02.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.238+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:39:02.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.246+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:02.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.255+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:39:02.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.274+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:39:02.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.283+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:39:02.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.297+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:39:02.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.298+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:39:02.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.302+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:39:02.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.337+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:39:02.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.354+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:39:02.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.358+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:39:02.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.375+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:39:02.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.377+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:39:02.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.383+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:39:02.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.396+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:39:02.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.406+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:39:02.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.420+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:39:02.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.430+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:39:02.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.430+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:39:02.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.440+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:39:02.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.445+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:39:02.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.464+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:39:02.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.475+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:39:02.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.485+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:39:02.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.490+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:39:02.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.512+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:39:02.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.526+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:39:02.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.528+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:39:02.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.542+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:39:02.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.566+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:39:02.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.567+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:39:02.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.574+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:39:02.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.578+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:39:02.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.596+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:39:02.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:39:02.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.644+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:39:02.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.656+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:39:02.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.666+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:39:02.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.672+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:39:02.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.684+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:39:02.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.703+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:39:02.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.708+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:39:02.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.711+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:39:02.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.726+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:39:02.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.736+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:39:02.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 159 16 2163061 2163045 850.178 866 0.00095195 0.00116545 2024-09-17T16:39:02.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.758+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:39:02.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.777+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:39:02.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.779+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:39:02.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.833+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:39:02.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.837+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:39:02.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.852+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:39:02.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.857+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:39:02.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.861+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:39:02.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.871+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:39:02.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.882+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:39:02.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.891+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:39:02.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.916+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:39:02.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.934+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:39:02.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.947+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:39:02.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.960+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:39:02.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.965+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:39:02.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.979+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:39:02.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.990+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:39:02.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.997+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:39:03.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:02.998+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:39:03.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.009+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:39:03.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.017+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:39:03.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.022+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:39:03.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.047+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:39:03.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.050+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:39:03.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.069+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:39:03.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.071+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:39:03.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.075+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:39:03.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.089+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:39:03.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.116+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:39:03.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.126+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:39:03.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.138+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:39:03.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.141+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:39:03.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.190+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:39:03.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.207+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:39:03.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.209+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:39:03.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.236+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:39:03.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.246+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:39:03.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.250+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:39:03.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.258+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:39:03.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.281+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:39:03.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.284+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:03.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.303+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:39:03.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.303+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:39:03.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.304+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:39:03.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.316+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:03.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.318+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:39:03.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.358+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:39:03.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.366+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:39:03.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.378+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:39:03.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.379+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:39:03.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.397+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:39:03.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.402+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:39:03.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:39:03.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.438+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:03.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.447+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:39:03.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.456+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:39:03.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.463+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:39:03.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.482+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:39:03.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.504+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:39:03.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.506+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:39:03.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.517+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:39:03.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.520+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:03.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.536+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:39:03.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.543+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:39:03.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.546+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:39:03.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.567+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:39:03.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.573+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:39:03.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.578+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:39:03.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.587+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:39:03.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.599+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:39:03.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.609+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:39:03.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.610+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:39:03.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.621+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:39:03.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.625+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:39:03.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.647+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:39:03.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:39:03.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.661+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:39:03.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.668+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:39:03.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.668+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:39:03.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.679+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:39:03.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.680+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:39:03.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.719+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:39:03.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.727+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:39:03.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.730+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:39:03.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.734+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:39:03.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:39:03.750036+0000 min lat: 0.000227768 max lat: 0.141438 avg lat: 0.00116527 2024-09-17T16:39:03.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:39:03.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 160 15 2176967 2176952 850.296 869.188 0.00142713 0.00116527 2024-09-17T16:39:03.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.760+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:39:03.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.779+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:39:03.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.791+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:39:03.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.792+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:39:03.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.816+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:39:03.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.820+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:39:03.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.843+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:39:03.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.845+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:39:03.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.865+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:39:03.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.880+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:39:03.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.890+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:39:03.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.898+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:39:03.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.923+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:39:03.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.927+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:39:03.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.928+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:39:03.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.929+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:39:03.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.946+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:39:03.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.969+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:03.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.969+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:39:04.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:03.999+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:39:04.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.000+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:39:04.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.002+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:39:04.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.022+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:39:04.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.033+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:39:04.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.038+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:39:04.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.038+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:39:04.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.050+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:39:04.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.076+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:39:04.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.085+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:39:04.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.087+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:39:04.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.106+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:04.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.119+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:39:04.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.125+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:39:04.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.140+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:39:04.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:39:04.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.157+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:39:04.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.163+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:39:04.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.163+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:39:04.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.191+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:39:04.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.199+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:39:04.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.210+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:39:04.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.211+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:39:04.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.219+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:39:04.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.230+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:39:04.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.232+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:39:04.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.273+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:39:04.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.273+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:04.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.276+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:39:04.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.278+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:39:04.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.287+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:39:04.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.299+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:39:04.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:39:04.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.336+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:39:04.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.344+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:39:04.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.349+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:39:04.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.361+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:39:04.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.365+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:39:04.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.372+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:39:04.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.382+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:39:04.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.391+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:39:04.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.396+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:39:04.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:39:04.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.424+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:39:04.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.435+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:39:04.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.450+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:39:04.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.457+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:39:04.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.479+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:39:04.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.479+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:39:04.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.495+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:39:04.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.503+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:39:04.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.519+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:39:04.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.524+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:39:04.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.528+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:39:04.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.552+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:39:04.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.553+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:39:04.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.559+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:39:04.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.569+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:04.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:39:04.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.601+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:39:04.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.604+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:39:04.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:39:04.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.636+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:39:04.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.642+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:04.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.651+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:39:04.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.676+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:39:04.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.680+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:39:04.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.698+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:39:04.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.699+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:39:04.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.706+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:39:04.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.718+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:39:04.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.735+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:39:04.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.746+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:39:04.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 161 16 2190417 2190401 850.235 840.562 0.000682265 0.00116537 2024-09-17T16:39:04.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.760+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:39:04.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.760+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:39:04.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.777+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:39:04.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.784+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:39:04.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.792+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:39:04.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.798+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:39:04.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.817+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:39:04.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.820+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:39:04.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.834+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:39:04.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.836+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:39:04.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.840+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:39:04.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.872+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:39:04.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.875+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:39:04.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.881+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:39:04.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.889+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:39:04.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.906+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:39:04.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.923+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:39:04.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.932+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:39:04.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.932+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:04.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.949+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:39:04.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.951+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:39:04.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:04.975+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:39:05.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.000+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:39:05.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.010+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:39:05.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.031+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:39:05.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.033+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:39:05.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.035+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:39:05.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.045+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:39:05.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.049+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:39:05.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.094+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:39:05.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.104+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:39:05.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.107+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:39:05.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.119+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:39:05.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.135+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:39:05.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.156+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:39:05.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.169+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:39:05.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.170+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:39:05.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.201+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:39:05.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.202+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:39:05.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.227+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:39:05.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.235+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:39:05.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.241+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:39:05.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.261+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:39:05.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.274+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:39:05.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.284+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:39:05.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.285+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:39:05.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.289+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:39:05.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.302+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:39:05.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.407+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:39:05.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.409+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:39:05.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.419+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:39:05.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.444+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:39:05.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.448+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:39:05.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.454+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:39:05.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.475+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:39:05.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.493+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:39:05.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.493+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:39:05.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.498+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:39:05.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.517+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:39:05.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.519+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:39:05.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.534+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:39:05.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.547+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:39:05.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.550+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:39:05.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.563+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:39:05.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.566+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:39:05.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.585+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:39:05.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.601+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:39:05.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.606+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:39:05.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.607+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:39:05.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.624+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:39:05.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.629+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:39:05.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.664+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:39:05.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.685+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:39:05.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.688+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:39:05.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.690+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:39:05.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.695+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:39:05.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.717+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:39:05.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.735+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:39:05.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.740+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:39:05.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.742+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:39:05.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 162 16 2202896 2202880 849.801 779.938 0.000547264 0.00116597 2024-09-17T16:39:05.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.767+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:39:05.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.781+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:39:05.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.824+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:39:05.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.839+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:39:05.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.842+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:39:05.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.857+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:39:05.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.876+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:39:05.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.890+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:05.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.897+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:39:05.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.909+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:39:05.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.917+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:39:05.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.919+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:39:05.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.929+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:39:05.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.936+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:39:05.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.955+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:39:05.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.965+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:39:05.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.972+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:39:05.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.973+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:39:05.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:05.986+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:39:06.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.006+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:39:06.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.023+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:39:06.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.036+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:39:06.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.037+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:39:06.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.062+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:39:06.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.071+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:39:06.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.071+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:39:06.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.073+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:39:06.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.083+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:39:06.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.093+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:39:06.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.101+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:39:06.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:39:06.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.149+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:39:06.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.172+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:39:06.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.187+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:39:06.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.190+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:39:06.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.193+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:39:06.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.216+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:39:06.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.236+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:39:06.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.241+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:39:06.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.241+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:39:06.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.255+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:39:06.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.290+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:39:06.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.291+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:06.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.295+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:39:06.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.317+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:39:06.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.337+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:39:06.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.352+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:39:06.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.354+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:39:06.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.366+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:39:06.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.386+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:39:06.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.392+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:39:06.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.413+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:39:06.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.418+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:39:06.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.423+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:39:06.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.425+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:39:06.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.445+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:39:06.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.452+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:39:06.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.462+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:39:06.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.483+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:39:06.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.497+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:39:06.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.511+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:39:06.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.538+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:39:06.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.544+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:39:06.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.563+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:39:06.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.570+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:39:06.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.578+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:39:06.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.592+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:39:06.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:39:06.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:39:06.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.627+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:39:06.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.627+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:39:06.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.630+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:39:06.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.648+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:39:06.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.655+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:39:06.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.665+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:39:06.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.676+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:39:06.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.680+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:39:06.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.689+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:39:06.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.711+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:39:06.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.735+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:39:06.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.739+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:39:06.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 163 16 2216982 2216966 849.988 880.375 0.000612671 0.00116572 2024-09-17T16:39:06.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.755+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:39:06.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.758+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:39:06.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.791+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:39:06.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.816+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:39:06.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.832+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:39:06.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.840+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:39:06.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.842+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:39:06.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.849+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:39:06.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.850+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:06.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.877+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:39:06.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.892+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:39:06.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.892+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:39:06.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.916+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:39:06.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:39:06.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.925+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:39:06.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.934+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:39:06.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.935+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:39:06.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.944+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:06.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.950+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:39:06.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.954+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:39:06.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.984+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:07.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:06.997+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:39:07.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.003+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:39:07.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.009+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:39:07.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.017+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:39:07.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.030+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:39:07.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.032+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:39:07.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.060+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:39:07.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.084+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:39:07.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.091+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:39:07.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.092+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:39:07.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.107+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:39:07.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.139+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:39:07.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.149+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:39:07.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.154+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:39:07.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.175+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:39:07.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.176+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:39:07.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.186+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:39:07.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.203+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:39:07.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.214+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:39:07.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.221+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:39:07.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.226+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:39:07.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.230+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:39:07.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.245+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:39:07.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.254+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:39:07.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.275+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:39:07.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.277+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:39:07.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.298+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:39:07.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.308+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:39:07.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.330+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:07.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.345+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:39:07.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.349+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:39:07.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.351+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:07.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.364+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:39:07.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.391+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:39:07.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.419+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:39:07.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.435+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:39:07.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:39:07.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.446+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:39:07.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.452+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:39:07.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.454+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:39:07.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.467+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:39:07.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.493+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:39:07.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.500+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:39:07.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.510+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:39:07.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.522+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:39:07.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.524+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:39:07.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.530+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:39:07.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.543+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:39:07.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.558+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:39:07.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.560+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:39:07.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.564+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:39:07.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.585+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:39:07.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.610+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:39:07.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.614+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:39:07.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.617+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:39:07.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.627+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:39:07.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.659+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:39:07.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.662+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:39:07.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.670+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:39:07.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.694+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:39:07.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.697+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:39:07.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.704+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:39:07.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.707+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:39:07.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.712+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:39:07.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.740+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:39:07.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 164 15 2230579 2230564 849.987 849.875 0.00118834 0.00116569 2024-09-17T16:39:07.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.755+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:39:07.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.769+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:39:07.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.770+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:39:07.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.802+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:39:07.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.807+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:39:07.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.808+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:39:07.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.809+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:39:07.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.837+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:39:07.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.846+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:39:07.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.856+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:39:07.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.867+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:39:07.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.873+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:39:07.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.896+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:39:07.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.906+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:39:07.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.911+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:39:07.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.913+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:39:07.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.929+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:07.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.956+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:39:07.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.959+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:39:07.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.961+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:39:07.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.963+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:39:07.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.989+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:39:07.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:07.996+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:39:08.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.014+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:39:08.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.018+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:39:08.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.022+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:39:08.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.022+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:39:08.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.055+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:39:08.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.062+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:39:08.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.064+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:39:08.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.083+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:39:08.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.104+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:39:08.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.104+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:39:08.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.114+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:39:08.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.124+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:39:08.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.130+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:39:08.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.157+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:39:08.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.195+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:39:08.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.196+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:39:08.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.205+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:39:08.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.233+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:39:08.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.240+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:39:08.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.241+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:39:08.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.271+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:39:08.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.285+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:39:08.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.286+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:39:08.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.288+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:39:08.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.308+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:39:08.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.313+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:39:08.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.331+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:39:08.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.335+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:39:08.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:39:08.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.342+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:39:08.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.359+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:39:08.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.375+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:08.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:08.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.403+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:39:08.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.408+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:39:08.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.413+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:08.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.430+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:39:08.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.464+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:39:08.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.484+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:39:08.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.493+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:39:08.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.495+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:39:08.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.512+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:39:08.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.512+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:39:08.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.537+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:39:08.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.560+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:39:08.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.577+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:39:08.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.578+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:39:08.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.588+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:39:08.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.601+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:39:08.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.606+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:39:08.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.611+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:39:08.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.626+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:39:08.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.631+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:39:08.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.639+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:39:08.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.663+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:39:08.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.669+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:39:08.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:39:08.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.678+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:39:08.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.680+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:08.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.719+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:08.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.727+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:39:08.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.740+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:39:08.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.742+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:39:08.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 165 15 2244443 2244428 850.087 866.5 0.000452832 0.00116558 2024-09-17T16:39:08.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.765+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:39:08.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.809+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:39:08.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.834+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:39:08.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.851+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:39:08.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.856+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:39:08.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.880+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:39:08.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.893+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:39:08.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.895+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:39:08.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.902+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:39:08.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.916+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:39:08.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.919+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:39:08.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.957+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:39:08.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.959+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:39:08.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.960+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:39:08.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.973+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:39:08.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:08.988+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:39:09.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.019+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:39:09.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.020+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:39:09.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.029+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:39:09.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.031+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:09.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.048+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:39:09.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.064+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:39:09.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.081+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:39:09.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.085+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:39:09.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.095+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:39:09.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.096+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:39:09.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.112+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:09.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.113+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:39:09.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.113+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:39:09.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.131+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:09.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.150+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:39:09.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.175+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:39:09.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.200+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:39:09.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.221+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:39:09.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.238+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:39:09.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.247+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:39:09.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.269+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:09.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.274+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:39:09.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.289+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:39:09.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.293+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:39:09.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.311+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:39:09.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.320+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:39:09.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.322+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:39:09.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.326+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:39:09.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.339+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:39:09.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.360+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:39:09.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.362+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:39:09.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.364+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:39:09.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.371+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:39:09.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.387+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:09.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.388+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:39:09.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.421+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:39:09.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.441+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:39:09.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.450+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:09.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.451+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:39:09.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.467+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:09.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.477+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:39:09.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.482+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:39:09.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:39:09.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.497+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:39:09.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.520+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:39:09.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.533+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:39:09.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:39:09.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.547+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:39:09.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.562+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:39:09.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.569+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:39:09.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.579+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:39:09.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.582+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:39:09.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.592+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:39:09.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:39:09.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.604+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:39:09.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.607+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:39:09.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.632+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:39:09.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.656+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:39:09.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.663+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:39:09.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.666+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:39:09.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.682+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:39:09.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.685+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:39:09.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.721+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:39:09.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.733+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:39:09.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.736+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:39:09.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.737+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:39:09.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 166 16 2258277 2258261 850.173 864.562 0.000404624 0.00116545 2024-09-17T16:39:09.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.774+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:39:09.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.779+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:39:09.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.780+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:39:09.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.791+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:39:09.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.801+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:39:09.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.838+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:39:09.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.851+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:39:09.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.857+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:39:09.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.857+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:39:09.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.889+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:39:09.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.890+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:39:09.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.906+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:39:09.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.906+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:39:09.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.928+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:39:09.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.941+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:39:09.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.943+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:09.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.947+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:09.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.973+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:39:09.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.974+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:39:09.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.997+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:39:09.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:09.997+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:10.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.002+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:39:10.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.010+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:10.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.037+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:39:10.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.040+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:39:10.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.051+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:39:10.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.073+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:39:10.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.078+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:39:10.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.083+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:39:10.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.104+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:39:10.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.118+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:39:10.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.122+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:39:10.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.141+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:39:10.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.145+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:39:10.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.159+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:39:10.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.174+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:39:10.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.184+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:39:10.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:39:10.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.214+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:39:10.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.217+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:39:10.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.225+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:39:10.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.244+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:39:10.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.252+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:39:10.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.267+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:39:10.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.280+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:39:10.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.288+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:39:10.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.298+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:39:10.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.299+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:39:10.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.309+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:39:10.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.318+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:39:10.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.333+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:39:10.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.345+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:39:10.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.355+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:39:10.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.383+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:39:10.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.392+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:39:10.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.403+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:39:10.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.403+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:39:10.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.412+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:39:10.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.418+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:39:10.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.422+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:39:10.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.441+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:39:10.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.464+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:39:10.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.475+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:39:10.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.477+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:39:10.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.492+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:39:10.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.504+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:39:10.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.504+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:39:10.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.505+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:39:10.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.516+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:39:10.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.522+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:39:10.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.547+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:39:10.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.553+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:39:10.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.559+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:39:10.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.571+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:39:10.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.598+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:39:10.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.599+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:39:10.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.602+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:39:10.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.624+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:39:10.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.629+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:39:10.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.633+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:39:10.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.638+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:10.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.654+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:39:10.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.657+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:39:10.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.684+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:39:10.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.706+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:39:10.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.722+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:39:10.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.727+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:39:10.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.736+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:39:10.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.745+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:39:10.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 167 16 2271766 2271750 850.13 843.062 0.00288192 0.00116552 2024-09-17T16:39:10.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.767+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:39:10.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.768+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:39:10.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.788+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:39:10.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.796+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:39:10.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.805+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:39:10.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.813+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:39:10.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.823+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:39:10.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.838+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:39:10.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.848+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:39:10.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.860+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:39:10.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.868+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:39:10.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.870+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:39:10.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.876+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:39:10.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.905+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:39:10.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.914+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:39:10.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.922+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:39:10.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.925+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:39:10.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.943+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:39:10.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.951+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:39:10.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.963+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:39:10.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.969+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:39:10.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.984+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:39:10.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:10.987+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:39:11.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.013+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:39:11.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.025+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:39:11.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.033+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:39:11.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.046+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:39:11.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.048+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:39:11.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.065+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:39:11.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.093+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:39:11.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.097+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:39:11.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.098+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:39:11.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.116+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:39:11.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.123+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:39:11.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.140+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:39:11.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.158+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:39:11.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.159+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:39:11.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.159+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:39:11.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.169+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:39:11.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.191+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:39:11.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.200+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:39:11.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.209+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:39:11.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:39:11.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.223+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:39:11.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.256+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:39:11.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.262+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:39:11.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.265+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:39:11.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:39:11.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.285+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:39:11.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.317+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:39:11.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.317+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:39:11.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.324+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:39:11.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.343+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:39:11.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.349+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:39:11.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.379+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:39:11.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.388+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:39:11.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.394+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:39:11.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.402+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:39:11.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.407+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:39:11.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.408+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:39:11.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.437+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:39:11.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.447+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:39:11.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.452+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:39:11.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.454+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:39:11.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.461+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:39:11.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.479+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:39:11.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.487+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:39:11.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.490+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:39:11.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.504+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:39:11.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.528+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:39:11.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.531+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:39:11.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.550+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:39:11.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.557+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:39:11.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.563+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:39:11.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.583+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:39:11.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.601+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:39:11.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.606+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:39:11.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.621+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:39:11.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.623+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:39:11.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.651+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:39:11.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.663+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:39:11.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.670+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:39:11.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.686+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:39:11.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.690+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:39:11.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.707+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:39:11.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.711+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:39:11.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.712+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:39:11.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.728+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:39:11.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.739+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:39:11.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.747+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:39:11.751 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 168 16 2285140 2285124 850.045 835.875 0.00079853 0.00116564 2024-09-17T16:39:11.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.751+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:39:11.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.763+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:39:11.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.769+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:39:11.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.797+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:39:11.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.811+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:39:11.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.830+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:39:11.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.831+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:39:11.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.855+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:39:11.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.876+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:39:11.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.908+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:39:11.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.911+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:39:11.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:39:11.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.940+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:39:11.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.941+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:39:11.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:39:11.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.949+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:11.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.955+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:39:11.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.962+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:39:11.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:11.994+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:39:12.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.000+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:39:12.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.002+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:39:12.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.012+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:39:12.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.027+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:39:12.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.040+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:39:12.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.051+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:39:12.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.069+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:39:12.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.073+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:39:12.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.076+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:39:12.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.103+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:39:12.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.120+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:39:12.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.136+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:39:12.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.138+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:39:12.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.141+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:39:12.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.142+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:39:12.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.154+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:12.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.157+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:39:12.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.177+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:39:12.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.187+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:39:12.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.196+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:39:12.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.213+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:39:12.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.233+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:39:12.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.244+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:12.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.258+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:39:12.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.269+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:39:12.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.286+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:39:12.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.288+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:39:12.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.322+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:39:12.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.322+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:39:12.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.328+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:39:12.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.341+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:39:12.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.347+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:39:12.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.347+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:39:12.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.380+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:39:12.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.381+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:39:12.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.392+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:39:12.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.434+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:39:12.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:39:12.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.447+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:12.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.458+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:39:12.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.458+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:39:12.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.461+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:39:12.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.470+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:39:12.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.480+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:12.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.503+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:39:12.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.511+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:39:12.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.522+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:39:12.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.540+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:39:12.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.555+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:39:12.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:39:12.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.561+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:39:12.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.575+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:39:12.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:39:12.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.609+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:39:12.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.627+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:39:12.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.640+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:39:12.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.640+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:39:12.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.652+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:39:12.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.674+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:39:12.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.679+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:39:12.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.684+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:39:12.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.693+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:12.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.705+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:39:12.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.716+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:39:12.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.736+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:39:12.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.741+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:39:12.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 169 15 2298689 2298674 850.026 846.875 0.000805231 0.00116567 2024-09-17T16:39:12.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.755+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:39:12.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.756+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:39:12.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.756+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:12.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.768+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:39:12.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.793+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:39:12.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.804+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:39:12.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:39:12.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.812+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:39:12.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.827+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:39:12.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.830+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:39:12.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.831+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:12.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.858+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:39:12.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.875+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:39:12.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.885+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:39:12.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.886+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:39:12.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.897+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:39:12.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.899+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:39:12.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.904+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:39:12.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.922+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:12.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.956+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:39:12.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:39:12.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.981+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:39:12.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.982+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:39:12.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.983+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:39:12.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.987+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:39:12.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:12.988+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:39:13.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.012+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:39:13.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.018+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:39:13.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.059+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:39:13.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.059+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:39:13.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.070+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:39:13.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.082+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:39:13.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.083+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:13.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.120+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:39:13.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.144+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:39:13.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:39:13.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.150+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:39:13.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.174+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:39:13.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.179+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:39:13.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.189+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:39:13.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.195+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:39:13.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.206+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:39:13.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.211+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:13.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.233+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:39:13.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.234+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:39:13.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.254+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:13.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.257+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:39:13.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.258+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:39:13.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.280+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:39:13.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.298+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:13.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.303+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:39:13.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.324+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:39:13.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.328+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:39:13.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.329+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:39:13.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.354+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:39:13.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.359+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:39:13.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.360+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:13.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.370+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:39:13.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.374+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:39:13.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.393+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:39:13.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.412+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:39:13.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.431+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:39:13.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.439+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:39:13.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.456+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:13.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.458+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:39:13.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.460+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:39:13.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.463+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:39:13.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:39:13.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.490+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:39:13.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.505+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:39:13.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.534+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:39:13.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.537+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:39:13.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.555+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:39:13.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.562+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:39:13.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.577+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:39:13.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.591+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:39:13.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.595+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:39:13.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.605+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:39:13.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.610+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:39:13.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.633+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:39:13.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.641+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:39:13.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.660+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:39:13.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.668+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:39:13.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.673+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:39:13.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.688+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:39:13.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.700+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:39:13.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.702+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:39:13.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.715+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:39:13.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.722+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:39:13.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.740+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:39:13.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 170 16 2312161 2312145 849.978 841.938 0.00163621 0.00116573 2024-09-17T16:39:13.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.753+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:39:13.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.759+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:39:13.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.770+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:39:13.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.770+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:39:13.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.789+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:13.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.790+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:39:13.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.809+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:39:13.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.816+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:39:13.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.824+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:39:13.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.834+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:39:13.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.852+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:39:13.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.863+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:39:13.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.874+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:39:13.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.897+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:39:13.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.903+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:39:13.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.905+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:39:13.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.910+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:39:13.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.918+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:39:13.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.934+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:39:13.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.934+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:39:13.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.939+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:39:13.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.949+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:39:13.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.966+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:39:13.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.973+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:39:13.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:13.987+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:39:14.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.008+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:39:14.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.008+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:39:14.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.010+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:39:14.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.014+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:39:14.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.034+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:39:14.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:39:14.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.069+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:39:14.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.080+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:39:14.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.092+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:39:14.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.096+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:39:14.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.130+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:39:14.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.133+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:39:14.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.160+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:39:14.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.161+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:39:14.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.178+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:39:14.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.200+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:39:14.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.203+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:39:14.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.210+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:39:14.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.216+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:39:14.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.227+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:39:14.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.234+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:39:14.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.257+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:39:14.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.267+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:39:14.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.280+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:39:14.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.285+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:39:14.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.309+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:39:14.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.317+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:39:14.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.328+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:39:14.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.335+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:39:14.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.338+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:39:14.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.357+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:39:14.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.357+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:39:14.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.375+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:39:14.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.385+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:39:14.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.395+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:39:14.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.399+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:39:14.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.409+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:39:14.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.424+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:39:14.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.427+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:39:14.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.450+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:39:14.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.458+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:39:14.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.478+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:39:14.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.487+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:39:14.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.511+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:39:14.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.524+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:39:14.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.544+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:39:14.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.567+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:39:14.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.592+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:39:14.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.601+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:39:14.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.605+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:39:14.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.616+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:39:14.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.625+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:39:14.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.628+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:39:14.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.645+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:39:14.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.672+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:39:14.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.681+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:39:14.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.693+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:39:14.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.712+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:39:14.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.714+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:39:14.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.723+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:39:14.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.734+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:39:14.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.738+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:39:14.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 171 16 2325882 2325866 850.022 857.562 0.000795149 0.00116567 2024-09-17T16:39:14.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.754+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:39:14.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.755+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:39:14.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.770+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:39:14.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.780+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:39:14.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.787+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:39:14.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.789+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:39:14.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.822+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:39:14.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.823+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:39:14.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.834+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:39:14.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.848+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:39:14.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.851+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:39:14.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.879+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:39:14.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.890+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:39:14.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.915+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:39:14.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.939+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:39:14.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.945+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:14.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.946+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:39:14.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:14.956+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:39:15.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.008+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:39:15.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.009+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:15.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.009+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:39:15.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.040+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:39:15.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.057+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:39:15.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.077+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:39:15.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.086+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:39:15.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.090+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:39:15.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.101+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:39:15.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.112+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:39:15.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.134+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:39:15.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.140+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:39:15.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:39:15.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.172+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:39:15.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.177+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:39:15.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.181+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:39:15.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.192+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:39:15.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.207+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:39:15.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.208+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:39:15.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.214+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:39:15.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.253+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:39:15.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.254+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:39:15.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.261+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:39:15.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.270+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:39:15.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.289+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:39:15.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.289+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:39:15.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.302+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:39:15.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.315+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:15.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.319+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:39:15.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.322+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:39:15.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.345+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:39:15.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.350+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:39:15.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.356+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:39:15.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.362+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:39:15.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.432+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:39:15.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.455+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:39:15.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.462+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:39:15.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.480+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:39:15.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.485+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:39:15.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.495+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:39:15.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.503+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:39:15.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.521+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:39:15.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.527+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:15.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.529+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:39:15.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.550+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:39:15.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.551+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:39:15.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.561+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:39:15.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.578+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:39:15.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.580+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:39:15.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.593+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:39:15.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.605+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:39:15.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.609+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:39:15.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.620+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:39:15.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.671+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:39:15.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.677+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:39:15.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.677+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:39:15.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.696+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:39:15.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.702+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:15.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.702+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:39:15.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.715+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:39:15.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.731+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:39:15.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.744+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:39:15.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.749+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:39:15.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 172 16 2338976 2338960 849.837 818.375 0.000718587 0.00116591 2024-09-17T16:39:15.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.770+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:39:15.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.789+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:39:15.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.798+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:39:15.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.810+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:39:15.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.819+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:39:15.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.856+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:39:15.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.869+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:15.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.887+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:39:15.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.902+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:39:15.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:39:15.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.911+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:39:15.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.917+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:39:15.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.926+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:39:15.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.951+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:39:15.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.981+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:39:15.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.983+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:39:15.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.990+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:39:15.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:15.997+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:39:16.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.014+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:39:16.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.036+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:39:16.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.037+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:39:16.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.046+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:39:16.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.059+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:39:16.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.070+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:39:16.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.074+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:39:16.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.090+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:39:16.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.099+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:39:16.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.103+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:39:16.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.120+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:39:16.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.140+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:39:16.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.145+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:39:16.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.146+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:39:16.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.166+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:39:16.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.191+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:39:16.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.195+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:39:16.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.206+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:39:16.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.207+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:39:16.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.211+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:39:16.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.222+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:39:16.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.240+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:39:16.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.250+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:39:16.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.251+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:39:16.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.291+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:39:16.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.295+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:39:16.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.302+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:39:16.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.312+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:39:16.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.315+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:16.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.322+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:39:16.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.342+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:39:16.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.346+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:39:16.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.370+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:39:16.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.373+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:39:16.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.396+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:16.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.402+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:39:16.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.406+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:39:16.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.417+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:39:16.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.432+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:39:16.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.441+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:39:16.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.442+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:39:16.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.458+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:39:16.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.472+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:39:16.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.483+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:39:16.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.487+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:39:16.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.531+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:39:16.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.536+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:39:16.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:39:16.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.565+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:39:16.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.569+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:39:16.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.570+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:39:16.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.577+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:39:16.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.589+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:39:16.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.603+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:39:16.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.604+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:39:16.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.614+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:39:16.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:39:16.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.631+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:16.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:39:16.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.638+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:39:16.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.673+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:39:16.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.681+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:39:16.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.683+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:39:16.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.700+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:39:16.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.727+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:39:16.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.730+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:39:16.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.734+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:39:16.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.740+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:39:16.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.747+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:39:16.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 173 16 2352825 2352809 849.928 865.562 0.000743249 0.00116581 2024-09-17T16:39:16.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.751+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:39:16.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.756+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:39:16.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.766+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:39:16.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.769+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:39:16.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.804+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:39:16.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.838+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:39:16.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:39:16.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.859+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:39:16.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.865+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:39:16.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.878+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:39:16.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:39:16.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.915+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:39:16.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.921+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:39:16.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.936+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:39:16.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.939+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:39:16.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:39:16.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.945+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:39:16.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.948+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:39:16.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.996+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:39:17.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:16.998+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:39:17.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.019+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:39:17.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.024+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:17.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.051+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:39:17.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.061+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:39:17.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.065+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:39:17.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.076+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:39:17.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.078+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:39:17.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.097+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:17.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.100+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:39:17.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.128+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:39:17.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.131+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:39:17.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.142+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:39:17.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.143+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:39:17.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.150+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:39:17.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.180+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:39:17.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.191+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:39:17.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.191+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:39:17.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.198+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:39:17.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.200+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:39:17.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.204+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:39:17.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.212+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:39:17.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.246+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:39:17.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.253+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:39:17.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.259+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:39:17.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:39:17.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.293+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:39:17.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.299+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:39:17.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.304+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:39:17.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.322+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:39:17.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.339+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:17.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.341+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:39:17.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.367+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:39:17.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.378+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:39:17.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.382+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:39:17.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.395+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:39:17.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.397+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:39:17.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.420+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:39:17.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.429+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:39:17.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.448+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:39:17.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.450+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:39:17.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.454+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:39:17.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.464+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:39:17.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.482+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:39:17.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.487+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:39:17.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.499+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:39:17.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.518+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:39:17.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:39:17.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.563+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:39:17.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.568+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:39:17.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.585+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:17.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.594+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:39:17.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.601+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:39:17.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.624+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:39:17.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.627+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:39:17.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.629+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:39:17.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.665+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:39:17.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.671+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:39:17.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.672+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:39:17.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.686+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:39:17.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.706+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:39:17.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:39:17.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.730+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:39:17.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.740+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:39:17.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.745+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:39:17.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 174 16 2366726 2366710 850.036 868.812 0.000887908 0.00116566 2024-09-17T16:39:17.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.770+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:39:17.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.772+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:39:17.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.789+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:39:17.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.798+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:39:17.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.819+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:39:17.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.826+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:39:17.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.850+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:39:17.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.850+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:39:17.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.854+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:39:17.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.856+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:39:17.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.885+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:39:17.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.891+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:39:17.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.902+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:39:17.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.922+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:39:17.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.931+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:39:17.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.935+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:39:17.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.939+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:39:17.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.958+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:39:17.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.960+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:39:17.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.968+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:39:17.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:17.992+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:39:18.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.008+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:39:18.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.014+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:39:18.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:39:18.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.020+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:39:18.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.035+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:39:18.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.035+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:39:18.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.062+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:39:18.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.081+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:39:18.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.083+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:39:18.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.086+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:39:18.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.097+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:39:18.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.097+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:39:18.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.121+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:39:18.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.139+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:39:18.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.151+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:39:18.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.154+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:39:18.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.164+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:39:18.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.190+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:39:18.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.196+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:39:18.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.199+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:39:18.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:39:18.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.235+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:39:18.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.247+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:39:18.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.261+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:18.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.266+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:39:18.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.274+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:39:18.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.295+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:39:18.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.304+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:39:18.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.307+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:39:18.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.311+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:39:18.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.336+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:39:18.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.336+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:39:18.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.363+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:39:18.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.369+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:39:18.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.396+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:39:18.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.396+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:39:18.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.405+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:39:18.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.407+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:39:18.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.436+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:39:18.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.437+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:39:18.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.466+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:39:18.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.492+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:39:18.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.493+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:39:18.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.500+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:39:18.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.519+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:18.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.539+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:39:18.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.550+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:39:18.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.554+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:39:18.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.562+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:39:18.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.567+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:39:18.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:39:18.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.582+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:39:18.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.603+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:39:18.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.621+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:39:18.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.632+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:39:18.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.643+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:39:18.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.653+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:39:18.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:39:18.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.655+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:39:18.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.657+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:39:18.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:18.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.700+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:18.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.703+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:39:18.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:39:18.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.718+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:39:18.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.720+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:39:18.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.730+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:39:18.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 175 16 2380462 2380446 850.084 858.5 0.000501898 0.00116558 2024-09-17T16:39:18.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.771+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:39:18.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.775+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:39:18.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.776+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:39:18.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.808+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:39:18.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.811+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:39:18.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.842+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:39:18.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.848+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:39:18.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.849+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:39:18.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.853+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:39:18.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.884+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:39:18.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.885+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:39:18.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.894+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:39:18.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.898+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:39:18.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.921+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:39:18.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.926+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:39:18.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.951+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:39:18.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.958+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:39:18.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.963+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:39:18.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.967+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:39:18.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.971+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:39:18.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.988+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:39:18.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:18.989+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:39:19.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.015+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:39:19.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.022+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:39:19.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.032+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:39:19.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.036+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:39:19.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.043+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:39:19.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.057+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:39:19.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.079+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:39:19.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.081+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:39:19.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.088+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:39:19.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.089+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:39:19.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.093+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:39:19.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.121+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:39:19.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.135+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:39:19.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.139+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:19.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.157+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:39:19.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.164+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:39:19.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.194+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:39:19.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.226+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:39:19.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.236+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:39:19.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.252+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:39:19.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.256+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:39:19.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.263+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:39:19.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.277+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:39:19.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.292+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:39:19.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.297+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:39:19.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.298+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:39:19.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.311+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:39:19.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.323+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:19.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.331+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:39:19.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.336+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:39:19.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:39:19.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.342+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:39:19.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.350+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:39:19.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.381+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:39:19.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.397+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:39:19.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.412+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:19.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.414+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:39:19.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.430+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:39:19.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.430+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:39:19.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.458+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:39:19.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.470+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:39:19.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.480+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:39:19.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.489+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:39:19.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.501+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:19.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.501+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:39:19.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.523+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:39:19.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.526+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:39:19.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.534+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:39:19.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.536+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:39:19.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.552+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:39:19.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.565+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:39:19.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.576+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:39:19.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.577+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:39:19.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.600+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:39:19.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.625+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:39:19.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.630+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:39:19.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.651+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:39:19.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.666+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:39:19.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.673+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:39:19.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:39:19.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.704+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:39:19.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.707+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:39:19.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.738+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:39:19.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.744+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:39:19.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 176 16 2394332 2394316 850.179 866.875 0.000661627 0.00116545 2024-09-17T16:39:19.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.757+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:39:19.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.768+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:39:19.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.773+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:39:19.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.774+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:39:19.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.782+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:39:19.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.793+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:39:19.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.814+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:39:19.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.833+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:39:19.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.851+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:39:19.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.853+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:39:19.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.876+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:39:19.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.881+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:39:19.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.894+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:39:19.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.905+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:39:19.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.916+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:39:19.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:39:19.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.922+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:39:19.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.934+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:39:19.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:39:19.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.955+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:39:19.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.974+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:39:19.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.975+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:39:19.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.983+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:39:19.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:19.996+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:20.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.022+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:39:20.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.026+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:39:20.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.041+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:39:20.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.052+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:39:20.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.071+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:39:20.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.071+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:39:20.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.089+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:39:20.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.095+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:39:20.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.103+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:39:20.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:39:20.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.113+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:39:20.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.119+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:39:20.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.122+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:39:20.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.134+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:39:20.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.139+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:39:20.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.168+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:39:20.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.176+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:39:20.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.180+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:39:20.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.185+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:39:20.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.206+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:39:20.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:39:20.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.239+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:39:20.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.252+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:20.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.274+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:39:20.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.274+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:39:20.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.286+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:39:20.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.288+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:39:20.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.303+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:39:20.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.323+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:39:20.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.335+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:39:20.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.353+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:39:20.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.376+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:39:20.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.386+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:39:20.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.406+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:39:20.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.407+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:39:20.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.409+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:20.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.429+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:39:20.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.438+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:39:20.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.442+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:39:20.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.467+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:39:20.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.467+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:39:20.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.469+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:39:20.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.501+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:39:20.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.513+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:39:20.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.529+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:39:20.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.536+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:39:20.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.540+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:39:20.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.543+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:39:20.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.567+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:39:20.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:39:20.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.581+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:39:20.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.584+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:39:20.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.588+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:39:20.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.591+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:39:20.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.601+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:39:20.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.613+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:39:20.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.619+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:20.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.644+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:39:20.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.663+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:39:20.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.665+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:39:20.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.665+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:39:20.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.702+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:39:20.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.703+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:39:20.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.718+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:39:20.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.739+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:39:20.752 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 177 16 2408003 2407987 850.203 854.438 0.000695733 0.00116544 2024-09-17T16:39:20.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.751+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:39:20.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.754+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:39:20.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.778+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:39:20.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.782+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:39:20.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.789+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:39:20.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.797+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:39:20.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.814+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:39:20.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.817+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:39:20.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.826+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:39:20.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.850+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:39:20.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.869+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:39:20.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.891+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:39:20.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.892+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:20.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.896+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:39:20.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.928+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:39:20.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.940+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:39:20.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.949+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:39:20.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.962+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:39:20.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.973+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:39:20.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.977+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:39:20.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.984+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:39:20.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.987+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:39:20.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.995+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:39:21.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:20.998+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:39:21.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.055+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:39:21.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.083+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:39:21.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.101+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:39:21.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:39:21.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.138+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:39:21.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.158+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:21.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.160+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:39:21.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:39:21.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.209+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:39:21.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.211+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:39:21.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.219+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:39:21.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.238+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:39:21.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.256+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:39:21.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.261+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:39:21.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.269+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:39:21.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.278+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:39:21.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.279+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:39:21.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.322+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:39:21.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.337+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:39:21.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.352+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:39:21.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.369+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:39:21.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.373+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:39:21.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.382+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:39:21.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.400+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:39:21.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.421+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:39:21.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.446+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:39:21.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.447+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:39:21.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.455+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:39:21.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.468+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:39:21.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.477+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:39:21.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.491+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:21.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.500+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:39:21.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.533+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:39:21.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.545+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:39:21.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.559+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:39:21.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.562+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:39:21.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.578+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:39:21.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.580+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:39:21.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.584+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:39:21.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.618+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:39:21.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.618+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:39:21.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.626+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:39:21.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.653+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:39:21.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.659+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:39:21.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:39:21.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.684+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:39:21.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.687+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:39:21.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.688+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:39:21.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.697+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:39:21.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.726+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:39:21.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.726+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:39:21.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.750+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:39:21.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 178 16 2422355 2422339 850.465 897 0.000783507 0.00116508 2024-09-17T16:39:21.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.763+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:39:21.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.770+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:39:21.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.785+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:39:21.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.797+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:39:21.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.816+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:39:21.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.816+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:39:21.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.819+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:39:21.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.836+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:39:21.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.846+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:39:21.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.854+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:39:21.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.895+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:39:21.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.897+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:39:21.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.941+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:39:21.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.943+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:39:21.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.947+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:39:21.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.949+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:39:21.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.961+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:39:21.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.978+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:39:21.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.986+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:39:22.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:21.998+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:39:22.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.031+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:39:22.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.045+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:39:22.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.045+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:39:22.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.058+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:22.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.067+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:39:22.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.093+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:39:22.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.107+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:39:22.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:39:22.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.129+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:39:22.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.148+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:39:22.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.152+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:39:22.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.166+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:39:22.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.201+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:39:22.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.217+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:39:22.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.220+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:39:22.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.223+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:39:22.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.224+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:39:22.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.242+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:39:22.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.257+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:39:22.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.258+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:39:22.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.291+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:39:22.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.307+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:39:22.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.319+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:39:22.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.327+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:39:22.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.347+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:39:22.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.354+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:39:22.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.357+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:39:22.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.367+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:39:22.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.374+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:39:22.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.384+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:22.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.395+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:39:22.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.401+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:39:22.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.422+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:39:22.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.422+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:39:22.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.429+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:39:22.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.460+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:39:22.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.462+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:39:22.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.470+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:39:22.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.484+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:39:22.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.498+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:39:22.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.508+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:39:22.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.522+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:39:22.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.533+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:39:22.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.542+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:39:22.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.564+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:39:22.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.567+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:39:22.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.579+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:39:22.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.592+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:39:22.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.616+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:39:22.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.623+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:39:22.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.625+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:39:22.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.625+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:39:22.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.636+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:39:22.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.638+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:39:22.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.659+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:39:22.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.683+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:39:22.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.691+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:39:22.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.707+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:39:22.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.710+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:39:22.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.728+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:39:22.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.735+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:39:22.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.742+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:39:22.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.749+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:39:22.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 179 15 2436061 2436046 850.5 856.688 0.000975437 0.00116502 2024-09-17T16:39:22.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.754+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:39:22.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.792+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:39:22.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.793+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:39:22.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.828+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:22.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.851+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:39:22.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.853+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:39:22.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.865+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:39:22.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.868+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:22.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.886+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:39:22.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.894+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:39:22.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.898+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:39:22.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.919+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:22.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.926+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:39:22.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.933+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:39:22.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.935+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:39:22.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.945+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:39:22.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.952+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:39:22.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.970+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:39:22.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.980+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:39:22.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.987+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:39:22.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:22.995+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:39:23.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.020+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:39:23.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.028+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:39:23.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.031+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:23.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.042+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:39:23.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.056+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:39:23.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.059+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:39:23.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.061+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:39:23.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.111+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:39:23.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.119+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:39:23.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.136+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:39:23.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.147+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:39:23.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.160+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:39:23.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.168+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:39:23.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.187+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:39:23.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.188+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:39:23.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.190+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:39:23.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.197+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:39:23.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.217+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:39:23.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.221+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:39:23.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.233+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:39:23.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.258+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:39:23.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:39:23.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.296+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:39:23.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.312+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:39:23.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.319+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:39:23.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.326+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:39:23.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.328+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:23.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.331+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:39:23.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.354+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:39:23.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:39:23.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.370+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:39:23.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.373+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:39:23.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.379+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:39:23.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.384+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:39:23.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.391+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:39:23.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:39:23.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.428+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:39:23.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.432+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:39:23.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:39:23.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.436+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:39:23.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.453+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:39:23.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.467+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:39:23.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.487+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:39:23.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.488+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:39:23.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.489+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:39:23.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.510+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:39:23.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.549+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:39:23.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.550+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:39:23.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.573+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:39:23.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.573+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:39:23.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.580+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:39:23.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.583+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:39:23.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.591+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:39:23.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.608+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:39:23.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.623+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:39:23.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.626+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:39:23.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.647+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:39:23.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.647+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:39:23.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.664+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:23.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.679+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:39:23.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:23.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.704+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:39:23.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.705+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:39:23.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.726+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:39:23.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.740+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:23.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:39:23.751708+0000 min lat: 0.000227768 max lat: 0.141438 avg lat: 0.00116504 2024-09-17T16:39:23.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:39:23.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 180 16 2449633 2449617 850.486 848.188 0.000745156 0.00116504 2024-09-17T16:39:23.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.771+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:39:23.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.772+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:39:23.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.782+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:39:23.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.806+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:39:23.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.813+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:23.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.820+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:39:23.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.847+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:39:23.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.857+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:39:23.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.864+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:39:23.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.883+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:39:23.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.890+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:39:23.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.897+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:39:23.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.897+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:39:23.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.921+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:39:23.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.922+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:39:23.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.941+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:39:23.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:39:23.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.976+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:39:23.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.977+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:39:23.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.983+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:39:23.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.990+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:39:23.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:23.994+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:39:24.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.005+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:39:24.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.014+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:39:24.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.037+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:39:24.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.047+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:39:24.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.047+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:39:24.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.059+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:24.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.082+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:39:24.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.097+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:39:24.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.104+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:39:24.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.105+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:39:24.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.117+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:24.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.117+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:39:24.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.117+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:39:24.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.144+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:39:24.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.159+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:39:24.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.160+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:39:24.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.192+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:39:24.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.194+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:39:24.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.196+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:39:24.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.216+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:39:24.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.218+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:39:24.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.226+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:39:24.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.259+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:39:24.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.271+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:39:24.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.288+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:39:24.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.290+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:39:24.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.305+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:39:24.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.322+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:39:24.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.336+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:39:24.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.361+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:39:24.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.365+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:39:24.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.368+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:39:24.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.372+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:39:24.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.375+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:39:24.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.385+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:39:24.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.406+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:39:24.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.408+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:39:24.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.412+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:39:24.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.429+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:39:24.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.453+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:39:24.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.455+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:39:24.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:39:24.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.474+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:39:24.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.474+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:39:24.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.477+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:39:24.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.492+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:39:24.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.510+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:39:24.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.511+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:39:24.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.530+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:39:24.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.542+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:39:24.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.550+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:24.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.551+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:39:24.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.561+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:39:24.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.593+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:39:24.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.593+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:39:24.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.595+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:39:24.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.601+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:39:24.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.615+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:39:24.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.633+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:39:24.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.649+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:39:24.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.662+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:39:24.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.671+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:39:24.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.681+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:39:24.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.719+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:39:24.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.729+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:39:24.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.745+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:39:24.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 181 15 2463099 2463084 850.437 841.688 0.00110196 0.00116512 2024-09-17T16:39:24.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.751+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:39:24.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.775+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:39:24.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.776+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:39:24.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.784+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:24.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.795+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:39:24.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.806+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:39:24.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.806+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:39:24.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.810+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:39:24.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.819+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:39:24.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.829+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:39:24.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.858+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:39:24.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.875+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:39:24.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.883+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:39:24.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.897+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:39:24.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.912+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:39:24.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.914+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:24.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.930+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:39:24.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.934+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:39:24.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.939+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:39:24.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.969+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:39:24.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:24.990+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:39:25.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.000+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:39:25.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.002+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:39:25.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.014+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:39:25.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.018+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:39:25.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.027+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:39:25.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.035+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:39:25.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.057+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:39:25.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.061+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:39:25.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.068+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:39:25.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.069+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:39:25.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.073+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:39:25.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.093+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:39:25.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:39:25.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.115+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:39:25.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.125+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:39:25.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.133+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:39:25.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.138+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:39:25.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.159+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:39:25.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.180+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:39:25.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.192+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:39:25.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.195+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:39:25.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:39:25.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.201+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:39:25.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.208+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:25.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.214+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:39:25.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.227+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:39:25.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.249+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:25.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.257+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:39:25.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.260+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:39:25.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.265+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:39:25.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.286+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:39:25.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.291+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:39:25.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.308+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:39:25.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.319+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:39:25.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.327+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:39:25.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.340+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:39:25.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.355+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:39:25.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.359+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:39:25.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.375+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:39:25.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.383+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:39:25.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.407+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:39:25.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.427+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:25.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.429+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:39:25.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.460+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:39:25.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.466+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:39:25.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.476+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:39:25.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.477+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:39:25.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.492+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:39:25.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.494+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:39:25.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.494+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:39:25.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.510+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:39:25.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.530+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:39:25.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.538+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:39:25.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.558+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:39:25.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.566+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:39:25.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.569+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:39:25.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.583+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:39:25.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.585+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:39:25.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.592+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:39:25.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.599+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:39:25.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.602+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:39:25.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.617+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:39:25.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.634+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:39:25.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.635+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:39:25.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.644+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:39:25.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.645+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:39:25.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.649+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:39:25.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.693+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:39:25.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.694+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:39:25.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.715+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:39:25.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.730+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:39:25.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.733+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:39:25.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.744+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:39:25.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 182 16 2476235 2476219 850.275 820.938 0.00145124 0.00116534 2024-09-17T16:39:25.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.751+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:39:25.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.762+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:39:25.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.772+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:39:25.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.780+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:39:25.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.788+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:39:25.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.791+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:39:25.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.799+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:39:25.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:39:25.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.826+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:39:25.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.837+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:39:25.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.870+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:39:25.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.875+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:39:25.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.892+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:39:25.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.895+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:39:25.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.906+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:39:25.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.915+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:39:25.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.927+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:39:25.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.928+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:39:25.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:39:25.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.959+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:39:25.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.969+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:39:25.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.979+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:39:26.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:25.998+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:39:26.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.028+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:26.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.033+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:39:26.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.048+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:39:26.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.057+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:39:26.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:39:26.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.069+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:39:26.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.074+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:39:26.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:39:26.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.109+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:39:26.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.116+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:39:26.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.125+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:39:26.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.146+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:39:26.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.151+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:39:26.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.154+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:39:26.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.173+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:39:26.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.187+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:39:26.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.191+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:39:26.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.223+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:39:26.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.232+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:39:26.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.232+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:39:26.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.241+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:39:26.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.246+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:39:26.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.262+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:39:26.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.272+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:26.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.277+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:39:26.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.288+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:26.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.315+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:39:26.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.317+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:39:26.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:39:26.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.337+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:39:26.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.350+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:39:26.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.350+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:39:26.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:39:26.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.364+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:39:26.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.367+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:39:26.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.403+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:39:26.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.405+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:39:26.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.414+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:39:26.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.422+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:39:26.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.430+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:39:26.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.441+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:26.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.452+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:39:26.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.452+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:39:26.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.463+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:39:26.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.475+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:39:26.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.513+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:39:26.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.513+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:39:26.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.531+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:39:26.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.536+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:39:26.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.538+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:39:26.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.545+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:39:26.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.557+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:39:26.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.563+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:39:26.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.589+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:39:26.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.594+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:39:26.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.605+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:26.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.618+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:39:26.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.629+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:39:26.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.638+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:39:26.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.646+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:39:26.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.651+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:39:26.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.673+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:39:26.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.678+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:39:26.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.678+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:39:26.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.695+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:39:26.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.701+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:39:26.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.709+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:39:26.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.737+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:39:26.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.749+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:39:26.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 183 15 2489571 2489556 850.183 833.562 0.000662806 0.00116547 2024-09-17T16:39:26.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.752+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:39:26.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.754+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:39:26.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.760+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:39:26.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.792+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:39:26.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.815+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:39:26.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.815+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:39:26.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.823+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:39:26.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.830+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:39:26.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.839+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:39:26.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.850+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:39:26.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:26.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.888+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:39:26.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.910+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:39:26.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.913+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:39:26.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.923+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:39:26.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.933+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:39:26.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.945+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:39:26.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.961+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:39:26.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.967+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:39:26.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.977+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:39:26.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.994+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:39:27.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:26.999+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:39:27.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.011+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:39:27.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.023+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:39:27.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.042+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:39:27.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.055+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:27.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.062+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:39:27.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.069+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:39:27.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.077+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:39:27.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.090+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:39:27.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.107+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:39:27.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.123+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:39:27.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.125+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:39:27.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.128+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:39:27.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.132+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:39:27.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.140+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:39:27.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.165+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:39:27.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.187+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:39:27.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.194+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:39:27.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.202+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:39:27.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.222+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:39:27.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.229+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:39:27.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.238+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:39:27.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.247+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:39:27.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.263+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:39:27.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.276+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:39:27.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.305+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:39:27.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.315+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:39:27.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.324+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:39:27.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.326+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:39:27.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:39:27.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.337+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:39:27.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.339+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:39:27.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.340+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:39:27.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.357+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:39:27.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.364+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:39:27.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.378+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:39:27.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.382+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:39:27.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.394+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:27.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.409+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:27.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.414+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:39:27.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.430+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:39:27.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.436+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:27.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.452+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:39:27.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:39:27.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.475+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:27.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.478+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:39:27.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.492+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:39:27.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.496+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:39:27.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.504+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:39:27.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.523+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:27.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.537+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:39:27.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.555+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:39:27.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.597+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:39:27.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.631+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:39:27.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.635+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:39:27.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.639+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:39:27.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.641+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:39:27.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.650+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:39:27.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.666+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:27.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.676+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:39:27.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.684+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:39:27.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.690+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:39:27.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.703+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:39:27.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.719+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:39:27.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.734+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:39:27.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.745+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:39:27.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.747+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:39:27.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 184 16 2502934 2502918 850.101 835.125 0.000475964 0.00116558 2024-09-17T16:39:27.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.754+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:39:27.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.756+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:39:27.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.776+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:39:27.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.786+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:39:27.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.807+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:27.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.828+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:39:27.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.847+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:39:27.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.848+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:39:27.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.877+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:39:27.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.882+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:39:27.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.884+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:39:27.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.893+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:39:27.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.896+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:39:27.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.905+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:39:27.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.929+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:39:27.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:39:27.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.965+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:27.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.965+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:39:27.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.974+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:39:27.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.995+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:39:28.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.998+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:39:28.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:27.999+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:39:28.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.001+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:39:28.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.022+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:39:28.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.030+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:39:28.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:39:28.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.065+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:39:28.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.075+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:39:28.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.080+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:39:28.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.082+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:39:28.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.087+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:39:28.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.110+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:39:28.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.114+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:39:28.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.127+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:39:28.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.139+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:39:28.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.158+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:39:28.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.164+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:39:28.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.170+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:39:28.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.182+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:39:28.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.204+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:39:28.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.212+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:39:28.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.218+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:39:28.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.226+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:39:28.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.240+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:39:28.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.247+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:39:28.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.251+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:39:28.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.252+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:39:28.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.259+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:39:28.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.270+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:39:28.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.283+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:39:28.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.300+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:39:28.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.305+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:39:28.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.308+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:39:28.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.315+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:39:28.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.330+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:39:28.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.392+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:39:28.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.395+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:39:28.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.432+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:28.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.434+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:39:28.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.460+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:39:28.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.470+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:39:28.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.488+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:39:28.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.496+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:28.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.500+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:39:28.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:39:28.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.526+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:28.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.531+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:39:28.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.545+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:39:28.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.545+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:39:28.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.551+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:39:28.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:39:28.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.565+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:39:28.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.620+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:39:28.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.622+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:39:28.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.645+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:39:28.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.652+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:39:28.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.656+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:39:28.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.669+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:39:28.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.670+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:39:28.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.676+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:39:28.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.697+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:39:28.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.707+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:39:28.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.718+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:39:28.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.737+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:39:28.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.743+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:39:28.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 185 16 2516684 2516668 850.15 859.375 0.00165711 0.00116553 2024-09-17T16:39:28.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.768+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:39:28.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.771+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:39:28.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.797+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:39:28.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.798+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:39:28.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.799+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:39:28.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.818+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:39:28.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.825+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:39:28.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.856+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:39:28.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.862+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:39:28.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.870+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:39:28.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.877+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:39:28.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:39:28.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.911+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:39:28.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.915+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:39:28.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.917+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:39:28.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.921+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:39:28.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:39:28.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.942+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:39:28.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:39:28.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.965+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:39:28.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:28.975+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:39:29.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.004+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:29.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.061+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:39:29.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:39:29.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.072+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:39:29.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.074+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:39:29.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.093+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:39:29.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.096+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:29.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.115+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:39:29.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.143+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:39:29.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.159+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:39:29.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.168+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:39:29.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.184+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:39:29.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.186+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:39:29.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.211+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:39:29.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.212+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:39:29.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:39:29.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.232+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:39:29.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.271+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:39:29.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.272+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:39:29.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.304+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:39:29.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.318+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:39:29.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.338+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:39:29.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.340+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:39:29.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.344+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:29.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.347+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:39:29.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.397+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:39:29.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.408+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:39:29.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.410+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:29.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.418+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:39:29.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.420+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:39:29.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.423+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:39:29.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.424+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:39:29.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.443+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:39:29.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.467+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:39:29.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.477+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:39:29.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.489+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:39:29.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.506+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:39:29.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.517+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:39:29.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.523+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:39:29.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.533+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:39:29.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.535+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:39:29.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.554+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:39:29.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.555+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:39:29.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.566+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:39:29.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.583+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:39:29.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.604+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:39:29.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.617+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:39:29.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.626+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:39:29.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.645+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:39:29.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.646+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:39:29.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.666+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:39:29.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.679+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:39:29.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:29.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.702+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:39:29.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.713+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:39:29.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.729+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:39:29.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.750+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:39:29.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 186 16 2530757 2530741 850.308 879.562 0.000459724 0.00116531 2024-09-17T16:39:29.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.752+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:39:29.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.753+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:39:29.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.753+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:39:29.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.786+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:39:29.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.797+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:39:29.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.802+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:39:29.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.808+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:39:29.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.813+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:39:29.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.825+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:39:29.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.836+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:39:29.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.851+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:39:29.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.855+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:39:29.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.871+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:39:29.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.878+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:39:29.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.897+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:39:29.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.902+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:39:29.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.918+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:39:29.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.932+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:39:29.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.948+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:39:29.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.949+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:39:29.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:39:29.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.971+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:39:30.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:29.998+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:39:30.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:39:30.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.036+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:39:30.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.040+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:39:30.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.045+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:39:30.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.058+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:39:30.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.074+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:39:30.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.087+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:39:30.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.096+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:39:30.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.101+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:39:30.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.102+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:39:30.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:39:30.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.113+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:39:30.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.122+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:39:30.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.143+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:39:30.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.147+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:39:30.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.166+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:39:30.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.178+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:39:30.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.180+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:39:30.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.186+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:39:30.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.215+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:39:30.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.225+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:39:30.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.243+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:39:30.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.253+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:39:30.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.253+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:39:30.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.271+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:39:30.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.289+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:39:30.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.309+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:39:30.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.309+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:39:30.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.319+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:39:30.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.327+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:39:30.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.331+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:39:30.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.333+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:39:30.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.367+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:30.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.374+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:39:30.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.374+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:39:30.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.392+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:39:30.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.446+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:39:30.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.449+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:30.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.457+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:39:30.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.477+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:39:30.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.525+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:39:30.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.564+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:39:30.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.569+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:39:30.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.575+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:39:30.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.582+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:39:30.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.606+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:39:30.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.611+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:39:30.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.623+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:39:30.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.635+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:39:30.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.653+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:39:30.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.667+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:39:30.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.671+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:39:30.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.687+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:39:30.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.704+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:39:30.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.712+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:39:30.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.714+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:39:30.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.723+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:39:30.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.741+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:39:30.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 187 16 2544307 2544291 850.289 846.875 0.000644074 0.00116533 2024-09-17T16:39:30.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.757+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:39:30.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.763+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:39:30.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.773+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:39:30.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.787+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:39:30.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.789+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:39:30.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.796+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:39:30.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.800+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:39:30.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:39:30.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.848+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:39:30.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.857+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:39:30.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.867+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:39:30.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.890+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:39:30.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.898+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:39:30.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.913+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:30.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:39:30.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.951+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:39:30.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.953+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:39:30.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.968+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:39:30.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.970+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:39:30.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.972+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:39:30.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:30.980+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:39:31.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.018+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:39:31.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.039+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:39:31.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.046+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:39:31.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.050+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:39:31.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.056+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:39:31.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.061+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:39:31.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.100+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:39:31.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.101+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:39:31.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.103+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:39:31.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.104+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:39:31.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.128+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:39:31.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:39:31.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.145+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:39:31.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.162+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:39:31.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.167+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:39:31.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.191+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:39:31.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:39:31.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.203+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:39:31.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.214+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:39:31.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.218+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:39:31.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.229+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:39:31.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.252+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:39:31.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.264+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:39:31.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.274+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:39:31.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.286+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:39:31.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.305+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:39:31.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.307+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:39:31.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.334+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:39:31.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.340+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:39:31.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.345+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:39:31.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.353+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:39:31.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.371+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:39:31.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.383+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:39:31.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.385+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:39:31.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.438+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:39:31.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.441+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:39:31.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:39:31.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.470+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:39:31.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.471+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:39:31.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.480+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:39:31.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.491+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:39:31.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.503+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:39:31.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.520+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:39:31.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.549+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:39:31.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.552+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:39:31.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.555+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:39:31.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.566+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:39:31.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.567+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:39:31.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.572+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:39:31.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.615+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:39:31.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.632+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:39:31.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.638+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:39:31.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.644+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:39:31.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.660+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:39:31.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.675+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:39:31.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.691+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:39:31.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.697+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:39:31.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.700+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:39:31.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.716+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:39:31.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:39:31.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.734+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:39:31.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.741+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:39:31.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.744+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:39:31.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.748+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:39:31.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 188 16 2558335 2558319 850.43 876.75 0.00106347 0.00116513 2024-09-17T16:39:31.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.752+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:39:31.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.762+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:39:31.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.792+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:39:31.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.796+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:39:31.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.832+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:39:31.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.852+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:39:31.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.863+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:39:31.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.865+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:39:31.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.869+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:39:31.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.884+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:39:31.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.907+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:39:31.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.923+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:39:31.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.929+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:39:31.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.934+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:39:31.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.947+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:39:31.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.957+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:39:31.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.986+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:39:31.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.995+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:39:32.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:31.999+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:39:32.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.025+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:39:32.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.031+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:39:32.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.047+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:39:32.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.054+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:39:32.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.056+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:39:32.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.065+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:39:32.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.068+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:39:32.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.085+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:39:32.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.097+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:39:32.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.112+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:39:32.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.115+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:39:32.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.134+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:39:32.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.150+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:39:32.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.169+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:39:32.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:39:32.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.179+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:39:32.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.212+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:39:32.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:39:32.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.215+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:39:32.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.220+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:39:32.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.243+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:39:32.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.266+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:39:32.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.271+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:39:32.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.284+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:39:32.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:39:32.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.318+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:39:32.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.340+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:32.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.362+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:39:32.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.365+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:39:32.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.369+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:39:32.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.375+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:39:32.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.394+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:39:32.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.395+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:39:32.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.406+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:39:32.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:39:32.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.443+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:39:32.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.452+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:39:32.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.459+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:39:32.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.467+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:39:32.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.489+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:39:32.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:39:32.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.516+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:39:32.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.531+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:39:32.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:39:32.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.550+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:39:32.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.556+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:32.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.557+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:39:32.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.565+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:39:32.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.570+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:39:32.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.572+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:39:32.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.578+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:39:32.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.601+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:39:32.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.605+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:39:32.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.608+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:39:32.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.629+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:39:32.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.637+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:39:32.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.638+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:39:32.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.649+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:39:32.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.673+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:39:32.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.681+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:39:32.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.683+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:39:32.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.689+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:39:32.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.690+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:39:32.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.718+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:39:32.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.735+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:39:32.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.749+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:39:32.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 189 16 2572416 2572400 850.586 880.062 0.000569799 0.00116492 2024-09-17T16:39:32.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.763+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:39:32.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.775+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:39:32.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.777+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:39:32.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.793+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:32.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.800+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:39:32.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.805+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:39:32.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.837+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:39:32.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.846+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:39:32.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.860+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:39:32.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.869+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:39:32.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.885+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:39:32.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.889+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:39:32.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.893+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:39:32.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.899+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:39:32.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.917+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:39:32.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.917+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:39:32.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.944+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:39:32.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.948+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:39:32.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.952+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:39:32.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.972+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:39:32.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.985+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:39:32.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:32.996+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:39:33.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.003+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:39:33.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.022+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:39:33.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.031+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:39:33.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.038+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:39:33.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.075+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:39:33.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.096+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:39:33.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.102+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:39:33.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.120+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:39:33.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:39:33.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.156+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:39:33.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.181+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:39:33.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.182+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:33.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.195+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:39:33.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.203+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:39:33.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.229+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:39:33.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.232+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:39:33.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.249+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:39:33.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.258+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:39:33.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.262+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:39:33.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.268+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:39:33.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.273+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:39:33.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.278+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:33.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.288+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:39:33.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.293+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:39:33.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.328+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:39:33.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.352+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:39:33.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.358+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:39:33.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.364+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:39:33.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.371+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:39:33.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.397+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:39:33.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.397+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:39:33.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.406+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:39:33.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.416+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:39:33.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.421+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:39:33.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.439+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:39:33.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.446+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:39:33.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.456+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:39:33.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.475+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:39:33.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.478+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:39:33.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.479+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:39:33.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.490+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:39:33.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:39:33.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.517+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:39:33.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.526+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:39:33.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.530+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:39:33.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.554+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:39:33.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.561+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:39:33.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.568+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:39:33.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.582+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:39:33.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.593+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:39:33.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.605+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:39:33.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.611+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:39:33.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.625+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:39:33.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.628+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:39:33.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.633+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:39:33.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.641+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:39:33.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.650+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:39:33.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.670+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:39:33.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.689+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:33.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.708+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:39:33.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.715+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:39:33.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.724+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:39:33.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.729+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:39:33.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.742+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:39:33.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 190 16 2585500 2585484 850.413 817.75 0.000562411 0.00116514 2024-09-17T16:39:33.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.772+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:39:33.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.782+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:39:33.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.796+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:39:33.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.802+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:39:33.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.805+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:39:33.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.819+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:39:33.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.841+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:39:33.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.871+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:39:33.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.874+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:39:33.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.880+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:39:33.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.883+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:39:33.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.888+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:39:33.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.896+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:39:33.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.928+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:39:33.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.935+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:39:33.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.951+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:39:33.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.959+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:39:33.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:33.975+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:39:34.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.000+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:39:34.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.009+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:39:34.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.029+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:39:34.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.032+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:39:34.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.036+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:39:34.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.070+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:39:34.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.077+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:39:34.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.085+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:39:34.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.094+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:39:34.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:39:34.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.121+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:39:34.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.146+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:39:34.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.153+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:39:34.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.155+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:39:34.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.178+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:34.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.180+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:39:34.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.215+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:39:34.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.219+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:39:34.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.238+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:39:34.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.255+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:39:34.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.273+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:39:34.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.296+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:39:34.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.298+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:39:34.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.308+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:39:34.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.333+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:39:34.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.355+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:39:34.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:39:34.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.368+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:39:34.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.375+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:39:34.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.404+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:39:34.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.419+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:39:34.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.436+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:39:34.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.437+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:39:34.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.454+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:39:34.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.465+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:39:34.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.477+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:34.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.494+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:39:34.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.494+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:34.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.513+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:39:34.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.524+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:39:34.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.527+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:39:34.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.536+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:39:34.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.539+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:39:34.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.552+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:34.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.569+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:39:34.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:39:34.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.579+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:39:34.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.579+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:39:34.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.602+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:39:34.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.605+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:39:34.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.609+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:39:34.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.628+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:39:34.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.637+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:39:34.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.640+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:39:34.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.643+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:39:34.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.654+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:39:34.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.678+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:39:34.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.684+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:39:34.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.698+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:39:34.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.702+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:39:34.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.708+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:39:34.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.719+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:39:34.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.734+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:39:34.753 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 191 15 2598705 2598690 850.281 825.375 0.00101495 0.00116533 2024-09-17T16:39:34.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.766+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:39:34.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.773+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:39:34.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.800+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:39:34.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.808+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:39:34.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.815+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:34.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.826+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:39:34.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.860+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:39:34.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.862+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:39:34.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.875+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:39:34.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.890+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:39:34.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.895+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:39:34.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.897+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:39:34.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.921+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:39:34.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.926+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:39:34.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.928+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:39:34.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.939+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:39:34.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.944+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:39:34.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.952+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:39:34.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.971+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:39:34.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.982+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:39:34.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.984+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:39:34.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:34.984+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:39:35.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.009+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:39:35.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.031+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:39:35.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.034+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:35.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.044+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:39:35.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.044+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:39:35.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.055+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:39:35.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.076+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:39:35.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.094+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:39:35.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.097+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:39:35.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.116+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:39:35.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.116+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:39:35.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.131+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:39:35.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.139+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:39:35.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.142+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:39:35.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.164+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:39:35.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.194+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:39:35.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.201+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:39:35.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:39:35.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.227+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:39:35.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.249+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:39:35.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.250+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:39:35.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.254+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:39:35.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.269+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:39:35.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.281+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:35.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.283+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:39:35.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.285+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:39:35.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.300+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:39:35.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:39:35.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.333+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:39:35.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:39:35.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.348+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:39:35.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.358+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:39:35.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.367+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:39:35.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.378+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:39:35.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:35.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:39:35.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:39:35.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:39:35.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.418+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:39:35.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.424+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:39:35.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.435+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:39:35.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.443+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:39:35.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.448+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:39:35.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.461+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:39:35.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.477+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:39:35.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.486+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:39:35.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.511+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:39:35.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.553+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:39:35.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.555+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:39:35.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.563+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:39:35.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.570+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:39:35.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.572+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:39:35.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.586+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:39:35.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.593+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:39:35.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.595+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:39:35.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.608+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:39:35.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.616+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:39:35.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.625+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:39:35.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.640+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:39:35.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.651+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:39:35.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.659+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:39:35.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.664+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:39:35.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.670+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:39:35.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.704+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:39:35.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.714+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:39:35.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.723+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:39:35.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.725+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:39:35.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.741+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:39:35.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.742+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:39:35.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.747+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:39:35.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 192 16 2612294 2612278 850.276 849.25 0.00255245 0.00116533 2024-09-17T16:39:35.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.753+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:39:35.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.761+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:39:35.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.781+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:39:35.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.797+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:39:35.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.812+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:35.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.828+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:35.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.853+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:39:35.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.859+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:39:35.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.877+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:39:35.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.894+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:39:35.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.898+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:39:35.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.900+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:39:35.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.905+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:39:35.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.941+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:39:35.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.942+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:39:35.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.963+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:39:35.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.969+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:39:35.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.981+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:39:35.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:35.993+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:39:36.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.017+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:36.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.037+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:39:36.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.038+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:39:36.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.064+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:39:36.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.092+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:39:36.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.118+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:39:36.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.119+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:36.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.140+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:39:36.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.147+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:39:36.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.157+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:39:36.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.178+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:39:36.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.190+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:39:36.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.221+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:39:36.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:39:36.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.225+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:39:36.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.228+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:39:36.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.265+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:39:36.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.265+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:39:36.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.276+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:39:36.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.304+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:39:36.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.328+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:39:36.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.332+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:39:36.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.358+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:39:36.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.367+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:39:36.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.367+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:39:36.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.372+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:39:36.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.380+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:39:36.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.410+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:39:36.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.412+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:39:36.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.425+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:39:36.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.433+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:39:36.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.440+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:39:36.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.450+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:39:36.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.462+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:39:36.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.473+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:39:36.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.487+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:39:36.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.488+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:39:36.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.501+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:39:36.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.534+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:39:36.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.555+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:39:36.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.573+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:39:36.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.576+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:36.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.580+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:39:36.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.581+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:36.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.611+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:36.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.614+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:39:36.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.621+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:39:36.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.625+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:39:36.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.651+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:39:36.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.656+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:39:36.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.675+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:36.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.675+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:39:36.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.688+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:39:36.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.704+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:39:36.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.718+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:39:36.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.725+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:39:36.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.736+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:36.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 193 16 2626521 2626505 850.477 889.188 0.00142998 0.00116506 2024-09-17T16:39:36.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.753+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:39:36.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.759+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:39:36.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.773+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:39:36.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.787+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:39:36.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.801+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:39:36.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.803+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:39:36.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.806+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:36.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.817+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:39:36.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.846+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:39:36.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.848+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:39:36.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.859+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:39:36.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.863+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:39:36.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.875+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:39:36.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.883+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:39:36.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.910+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:39:36.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.910+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:39:36.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.921+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:39:36.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.929+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:39:36.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.948+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:39:36.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.950+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:39:36.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.959+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:39:36.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.966+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:39:36.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.967+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:36.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.979+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:39:36.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:36.992+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:39:37.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.005+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:39:37.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.054+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:39:37.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.056+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:39:37.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.070+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:37.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.077+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:39:37.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.085+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:39:37.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.095+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:39:37.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.118+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:39:37.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.118+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:39:37.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.129+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:39:37.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.144+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:39:37.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.158+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:39:37.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.169+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:39:37.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.183+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:39:37.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.193+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:39:37.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.197+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:39:37.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:39:37.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.215+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:39:37.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.219+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:39:37.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.230+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:39:37.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.259+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:39:37.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.283+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:39:37.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.286+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:39:37.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.311+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:39:37.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.322+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:39:37.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.336+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:39:37.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:39:37.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.340+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:39:37.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.341+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:39:37.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.355+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:39:37.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.362+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:39:37.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.397+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:39:37.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.408+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:39:37.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.418+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:39:37.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.428+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:39:37.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.438+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:39:37.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.439+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:39:37.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.442+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:39:37.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.455+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:39:37.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.468+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:37.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.480+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:39:37.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.491+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:39:37.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.492+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:39:37.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.504+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:39:37.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.523+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:39:37.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.528+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:39:37.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.532+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:39:37.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.568+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:39:37.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.587+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:39:37.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.598+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:39:37.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.605+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:39:37.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.625+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:39:37.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.638+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:39:37.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.657+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:39:37.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.659+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:39:37.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:39:37.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.694+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:39:37.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.711+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:39:37.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.718+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:39:37.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:37.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.733+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:39:37.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 194 16 2640102 2640086 850.468 848.812 0.000652813 0.00116507 2024-09-17T16:39:37.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.761+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:39:37.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.766+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:39:37.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.775+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:39:37.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.789+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:39:37.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.792+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:39:37.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.803+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:39:37.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.806+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:39:37.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.814+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:39:37.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.818+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:39:37.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.829+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:37.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.849+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:39:37.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.856+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:37.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.863+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:39:37.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.881+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:39:37.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.889+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:39:37.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.901+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:39:37.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.911+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:37.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.930+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:39:37.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.952+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:39:37.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.955+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:39:37.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.976+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:39:37.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.977+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:39:37.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:37.991+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:39:38.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.020+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:39:38.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.021+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:39:38.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.037+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:39:38.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.041+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:39:38.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.056+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:39:38.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.061+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:39:38.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.080+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:39:38.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.089+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:39:38.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.099+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:39:38.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.105+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:39:38.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.121+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:39:38.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.127+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:39:38.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.134+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:39:38.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.138+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:39:38.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.162+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:39:38.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.162+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:39:38.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.180+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:39:38.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.195+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:39:38.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.204+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:39:38.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.206+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:39:38.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.208+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:39:38.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.217+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:39:38.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.250+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:39:38.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.251+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:39:38.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.263+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:39:38.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.272+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:39:38.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.274+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:39:38.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.284+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:39:38.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.286+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:39:38.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.306+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:39:38.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.308+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:39:38.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.336+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:39:38.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.339+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:39:38.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.349+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:39:38.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.351+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:39:38.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.360+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:39:38.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.375+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:39:38.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.386+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:39:38.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.403+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:39:38.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.411+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:38.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.423+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:39:38.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.437+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:39:38.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.439+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:39:38.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.450+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:39:38.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.468+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:39:38.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.481+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:39:38.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.482+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:39:38.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.482+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:39:38.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.505+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:39:38.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.510+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:39:38.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.526+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:39:38.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.533+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:39:38.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.557+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:39:38.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.560+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:39:38.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.569+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:39:38.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.581+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:39:38.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.594+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:39:38.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.595+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:38.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.603+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:39:38.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.628+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:39:38.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.631+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:38.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.634+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:39:38.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.643+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:39:38.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.668+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:39:38.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.673+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:39:38.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.684+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:39:38.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.716+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:39:38.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.716+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:39:38.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.729+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:38.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.743+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:39:38.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 195 15 2653617 2653602 850.438 844.75 0.00126754 0.0011651 2024-09-17T16:39:38.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.758+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:39:38.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.780+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:39:38.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.783+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:39:38.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.784+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:39:38.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.789+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:39:38.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.811+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:39:38.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.834+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:39:38.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.847+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:39:38.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.848+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:39:38.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.872+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:39:38.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.873+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:39:38.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.908+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:39:38.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.921+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:39:38.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.935+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:39:38.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.943+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:39:38.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.955+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:39:38.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.969+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:39:38.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.974+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:39:38.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.978+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:39:38.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.986+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:39:38.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.992+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:39:38.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:38.993+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:39:39.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.011+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:39:39.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.029+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:39:39.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.030+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:39:39.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.051+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:39:39.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.062+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:39:39.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.079+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:39:39.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.085+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:39:39.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.091+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:39:39.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.096+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:39:39.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.100+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:39:39.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.135+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:39:39.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:39:39.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.157+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:39:39.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.165+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:39:39.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.166+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:39:39.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.172+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:39:39.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:39:39.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.201+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:39:39.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.212+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:39:39.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.232+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:39:39.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.236+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:39:39.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.240+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:39:39.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.261+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:39:39.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.272+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:39:39.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.286+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:39:39.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.295+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:39:39.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.325+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:39:39.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.333+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:39:39.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.335+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:39:39.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.337+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:39:39.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.339+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:39:39.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.391+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:39:39.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.399+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:39:39.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.400+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:39:39.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.411+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:39:39.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.416+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:39:39.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.434+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:39:39.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.445+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:39:39.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.450+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:39:39.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.452+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:39:39.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.461+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:39:39.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.464+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:39:39.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.476+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:39:39.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.493+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:39:39.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.514+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:39:39.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.531+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:39:39.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.534+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:39:39.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:39:39.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.543+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:39:39.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.547+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:39:39.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.554+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:39:39.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.575+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:39:39.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.602+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:39.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.613+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:39:39.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.621+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:39:39.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.622+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:39:39.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.623+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:39:39.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.634+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:39:39.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.638+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:39:39.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.650+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:39:39.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.696+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:39:39.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.697+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:39:39.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.701+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:39:39.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.704+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:39:39.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.709+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:39:39.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.748+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:39:39.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.749+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:39.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 196 16 2666905 2666889 850.336 830.438 0.0010781 0.00116525 2024-09-17T16:39:39.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.753+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:39:39.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.753+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:39:39.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.769+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:39:39.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.803+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:39:39.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.805+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:39:39.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.820+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:39.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.840+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:39:39.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.845+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:39:39.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.856+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:39:39.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.860+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:39:39.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.886+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:39:39.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.887+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:39:39.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.896+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:39:39.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.910+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:39:39.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.927+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:39.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.943+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:39.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.946+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:39:39.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.947+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:39:39.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.964+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:39:39.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:39.990+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:39:40.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.004+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:39:40.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.004+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:39:40.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.018+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:39:40.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.045+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:39:40.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.046+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:39:40.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.051+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:39:40.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.081+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:39:40.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:39:40.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.089+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:39:40.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.120+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:39:40.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.120+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:39:40.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.121+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:40.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.122+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:39:40.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.142+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:39:40.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.155+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:39:40.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.169+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:39:40.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.184+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:39:40.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.191+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:39:40.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.200+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:39:40.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.204+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:40.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.214+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:39:40.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.242+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:39:40.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.252+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:39:40.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.257+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:39:40.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.273+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:39:40.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.273+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:40.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.286+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:39:40.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.307+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:39:40.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.310+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:39:40.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.334+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:39:40.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.340+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:39:40.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.355+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:39:40.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.366+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:39:40.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.372+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:40.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.377+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:39:40.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.383+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:39:40.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.387+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:39:40.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.388+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:39:40.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.497+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:39:40.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.506+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:39:40.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.541+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:39:40.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.549+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:39:40.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.555+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:39:40.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.568+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:39:40.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.573+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:39:40.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.592+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:39:40.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.594+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:39:40.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.613+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:39:40.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.639+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:39:40.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.668+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:39:40.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.686+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:39:40.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.695+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:39:40.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.698+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:39:40.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.705+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:39:40.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.717+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:39:40.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.718+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:39:40.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.737+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:39:40.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.741+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:39:40.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.746+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:39:40.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 197 16 2679431 2679415 849.993 782.875 0.000659748 0.00116572 2024-09-17T16:39:40.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.755+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:39:40.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.759+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:39:40.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.773+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:40.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.792+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:39:40.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.814+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:39:40.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.818+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:39:40.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.846+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:39:40.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.846+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:39:40.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.855+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:39:40.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.904+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:39:40.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.918+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:39:40.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.933+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:39:40.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.936+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:39:40.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.951+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:39:40.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.958+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:39:40.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.964+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:39:40.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.978+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:39:40.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.979+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:39:40.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:40.986+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:39:41.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.006+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:39:41.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.013+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:39:41.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.018+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:39:41.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.029+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:39:41.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.040+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:39:41.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.043+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:39:41.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.059+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:39:41.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.065+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:39:41.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:39:41.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.090+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:39:41.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:39:41.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.129+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:39:41.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.130+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:39:41.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.140+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:39:41.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.144+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:39:41.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.153+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:39:41.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.167+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:39:41.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.177+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:39:41.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:39:41.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.200+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:39:41.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.203+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:39:41.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.221+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:39:41.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.248+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:39:41.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.255+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:41.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.262+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:39:41.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.266+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:39:41.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.270+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:39:41.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.322+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:39:41.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.325+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:39:41.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.337+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:39:41.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.347+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:39:41.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.348+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:39:41.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.360+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:39:41.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.380+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:39:41.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.389+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:39:41.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.404+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:39:41.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.406+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:39:41.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.409+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:39:41.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.411+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:39:41.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.437+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:39:41.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.447+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:39:41.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.449+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:39:41.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.471+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:39:41.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.474+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:39:41.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.490+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:39:41.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.496+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:39:41.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.501+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:39:41.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.504+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:39:41.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.544+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:39:41.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.555+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:39:41.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.555+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:39:41.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.559+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:39:41.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.562+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:39:41.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.591+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:39:41.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.615+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:39:41.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.629+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:39:41.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.633+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:39:41.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.634+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:39:41.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.640+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:39:41.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.646+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:39:41.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.654+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:39:41.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.661+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:39:41.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.665+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:39:41.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.686+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:39:41.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.692+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:39:41.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.710+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:41.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.727+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:39:41.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.731+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:39:41.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.742+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:39:41.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 198 16 2692815 2692799 849.925 836.5 0.000530219 0.00116582 2024-09-17T16:39:41.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.785+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:39:41.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.804+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:39:41.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:39:41.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.829+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:39:41.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.832+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:39:41.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.854+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:39:41.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.879+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:39:41.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.884+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:39:41.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.889+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:39:41.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.897+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:39:41.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.917+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:39:41.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.919+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:41.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.926+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:39:41.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.932+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:39:41.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.952+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:39:41.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.956+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:39:41.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.966+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:39:41.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.966+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:39:41.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.982+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:39:41.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:41.983+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:39:42.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.012+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:39:42.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.037+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:39:42.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.044+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:39:42.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.064+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:39:42.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.069+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:39:42.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.074+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:39:42.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.079+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:39:42.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.098+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:39:42.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.103+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:39:42.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.121+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:39:42.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.130+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:39:42.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.137+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:39:42.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.140+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:39:42.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.150+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:39:42.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.181+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:39:42.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:39:42.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.217+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:39:42.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.219+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:39:42.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.252+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:39:42.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.266+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:39:42.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.293+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:39:42.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.307+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:39:42.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.340+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:39:42.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.343+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:39:42.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.344+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:39:42.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.361+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:39:42.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.404+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:39:42.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.416+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:39:42.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.421+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:39:42.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.426+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:39:42.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.440+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:39:42.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.448+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:39:42.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.453+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:39:42.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.472+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:39:42.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.486+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:39:42.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.504+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:39:42.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.510+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:39:42.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.515+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:39:42.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.521+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:39:42.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.523+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:39:42.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.526+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:39:42.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.534+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:39:42.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.557+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:39:42.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.559+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:39:42.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.570+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:39:42.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.595+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:39:42.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.603+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:39:42.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.613+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:39:42.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.619+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:39:42.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.690+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:39:42.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.701+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:39:42.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.707+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:39:42.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.709+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:39:42.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.742+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:39:42.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.750+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:39:42.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 199 16 2706068 2706052 849.816 828.312 0.0007013 0.00116597 2024-09-17T16:39:42.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.753+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:39:42.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.768+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:42.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.780+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:39:42.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.793+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:39:42.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.799+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:39:42.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.800+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:42.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.819+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:39:42.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.828+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:39:42.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.837+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:39:42.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.871+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:39:42.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.875+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:39:42.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.884+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:39:42.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.886+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:39:42.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.895+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:39:42.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:39:42.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.915+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:39:42.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.934+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:39:42.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.951+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:39:42.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.952+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:39:42.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.975+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:42.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.987+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:39:42.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.993+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:39:42.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:42.995+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:39:43.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.003+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:39:43.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.029+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:39:43.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.033+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:39:43.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.049+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:39:43.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.050+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:39:43.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.069+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:39:43.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.091+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:39:43.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.094+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:39:43.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.110+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:39:43.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.119+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:39:43.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.121+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:39:43.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.143+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:39:43.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.148+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:39:43.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.153+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:39:43.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:39:43.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.176+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:39:43.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.183+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:39:43.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.205+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:39:43.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.226+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:39:43.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:39:43.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.254+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:39:43.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.291+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:39:43.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.294+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:39:43.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.311+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:39:43.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.313+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:39:43.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.334+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:39:43.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.346+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:39:43.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.355+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:39:43.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.360+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:39:43.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.377+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:39:43.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.385+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:39:43.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.385+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:39:43.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.397+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:39:43.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.399+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:39:43.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.411+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:39:43.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.416+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:39:43.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.422+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:39:43.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.433+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:39:43.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.475+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:39:43.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.476+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:39:43.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.513+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:39:43.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.522+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:39:43.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.523+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:39:43.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.532+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:39:43.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.544+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:39:43.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.566+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:39:43.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.569+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:39:43.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.573+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:39:43.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.581+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:39:43.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.581+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:39:43.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:39:43.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.600+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:39:43.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.621+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:39:43.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.634+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:39:43.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.636+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:39:43.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.642+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:39:43.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.660+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:39:43.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.672+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:39:43.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.672+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:39:43.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.692+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:39:43.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.715+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:43.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.719+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:39:43.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.725+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:39:43.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.732+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:43.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.738+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:39:43.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:39:43.753443+0000 min lat: 0.000227768 max lat: 0.141438 avg lat: 0.00116604 2024-09-17T16:39:43.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:39:43.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 200 16 2719496 2719480 849.763 839.25 0.000702747 0.00116604 2024-09-17T16:39:43.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.771+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:39:43.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.776+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:39:43.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.785+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:39:43.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.797+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:39:43.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.798+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:39:43.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.800+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:39:43.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.821+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:39:43.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.828+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:39:43.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.870+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:39:43.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.885+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:39:43.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.896+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:43.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.904+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:39:43.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.914+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:39:43.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.924+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:39:43.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.927+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:39:43.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.942+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:39:43.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:39:43.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.972+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:39:43.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.983+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:39:43.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:43.987+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:39:44.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.007+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:44.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.010+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:39:44.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.014+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:39:44.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.017+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:39:44.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.029+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:39:44.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.030+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:39:44.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.052+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:39:44.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.096+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:39:44.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.142+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:39:44.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.148+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:39:44.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.150+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:39:44.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:39:44.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.202+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:39:44.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.204+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:39:44.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.209+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:39:44.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.214+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:39:44.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.239+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:39:44.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.253+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:39:44.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.263+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:39:44.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.265+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:39:44.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.272+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:39:44.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.286+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:39:44.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.310+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:39:44.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.319+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:39:44.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.324+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:39:44.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.332+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:39:44.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:39:44.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.344+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:39:44.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.366+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:44.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.369+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:39:44.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.380+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:39:44.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.393+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:39:44.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.395+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:39:44.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.400+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:44.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.440+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:39:44.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.480+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:39:44.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.486+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:39:44.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.502+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:39:44.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.524+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:39:44.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.533+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:44.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.556+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:39:44.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.559+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:39:44.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.570+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:39:44.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:39:44.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:39:44.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.603+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:44.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.610+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:39:44.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.626+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:39:44.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.634+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:39:44.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.659+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:39:44.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.678+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:39:44.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.688+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:39:44.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.704+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:39:44.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.718+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:39:44.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.743+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:44.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.746+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:39:44.754 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 201 16 2733768 2733752 849.972 892 0.000626027 0.00116576 2024-09-17T16:39:44.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.752+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:39:44.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.771+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:39:44.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.783+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:39:44.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.789+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:39:44.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.797+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:39:44.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.798+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:44.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.805+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:39:44.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:39:44.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.847+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:39:44.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.864+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:39:44.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.874+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:39:44.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.882+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:39:44.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.896+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:39:44.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.899+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:39:44.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.910+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:39:44.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.918+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:39:44.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.936+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:39:44.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.943+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:39:44.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.946+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:39:44.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.970+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:39:44.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.975+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:39:44.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.981+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:39:44.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:44.988+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:39:45.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.026+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:39:45.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.036+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:39:45.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.037+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:39:45.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.054+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:39:45.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.070+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:39:45.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.073+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:39:45.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.092+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:39:45.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.096+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:45.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.127+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:39:45.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.149+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:39:45.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.152+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:39:45.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.163+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:39:45.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.164+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:39:45.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.202+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:39:45.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.216+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:39:45.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.232+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:39:45.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.238+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:39:45.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.245+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:39:45.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.259+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:39:45.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.267+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:39:45.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.280+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:45.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.339+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:39:45.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.341+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:39:45.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.353+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:39:45.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.367+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:39:45.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.376+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:39:45.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.384+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:39:45.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.395+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:39:45.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.404+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:39:45.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.421+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:39:45.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.442+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:39:45.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.450+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:39:45.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.483+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:39:45.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.500+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:39:45.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.507+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:39:45.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.508+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:39:45.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.517+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:39:45.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.517+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:39:45.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.546+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:39:45.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.548+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:39:45.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.558+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:39:45.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.563+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:39:45.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:39:45.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:39:45.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.595+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:39:45.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.605+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:39:45.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.613+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:39:45.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.626+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:39:45.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:39:45.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.652+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:39:45.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.653+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:39:45.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.654+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:39:45.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.689+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:45.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.700+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:39:45.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.708+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:39:45.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.711+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:45.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.719+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:39:45.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.749+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:39:45.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 202 16 2747140 2747124 849.901 835.75 0.00120564 0.00116586 2024-09-17T16:39:45.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.755+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:39:45.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.771+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:39:45.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.773+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:39:45.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.773+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:39:45.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.786+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:39:45.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.801+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:39:45.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.828+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:39:45.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.831+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:39:45.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.832+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:39:45.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.865+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:39:45.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.881+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:39:45.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.895+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:39:45.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.906+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:39:45.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.920+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:39:45.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.929+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:39:45.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.942+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:39:45.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.951+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:39:45.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.975+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:39:45.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.979+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:39:45.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:45.983+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:39:46.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.001+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:39:46.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.011+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:39:46.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.029+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:39:46.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.043+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:39:46.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.066+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:39:46.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.070+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:39:46.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.083+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:39:46.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.090+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:39:46.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.101+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:39:46.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.122+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:39:46.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.139+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:39:46.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.143+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:39:46.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.148+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:46.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.148+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:39:46.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.172+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:39:46.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.199+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:39:46.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.224+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:39:46.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.243+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:39:46.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.248+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:39:46.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.248+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:39:46.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.261+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:39:46.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.273+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:39:46.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.290+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:39:46.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.292+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:46.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.336+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:39:46.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.348+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:39:46.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.355+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:39:46.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.364+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:39:46.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.373+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:39:46.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.376+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:39:46.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.389+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:39:46.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.395+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:39:46.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.395+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:39:46.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.406+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:39:46.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.416+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:39:46.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.425+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:39:46.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.433+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:39:46.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.460+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:39:46.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.474+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:39:46.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.512+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:39:46.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.533+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:39:46.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.534+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:39:46.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.562+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:39:46.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.567+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:39:46.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.569+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:39:46.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.576+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:46.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.586+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:39:46.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.602+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:39:46.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.619+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:46.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.620+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:39:46.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.623+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:39:46.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.634+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:39:46.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.655+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:39:46.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.664+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:39:46.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.669+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:39:46.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.699+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:39:46.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.705+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:39:46.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.708+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:39:46.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.723+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:39:46.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.734+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:39:46.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 203 16 2761241 2761225 850.055 881.312 0.00136644 0.00116564 2024-09-17T16:39:46.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.760+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:39:46.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.770+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:39:46.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.777+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:39:46.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.846+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:39:46.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.852+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:39:46.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.863+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:39:46.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.885+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:39:46.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.899+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:39:46.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.899+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:39:46.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.916+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:46.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.927+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:39:46.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.940+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:39:46.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.959+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:39:46.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.962+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:39:46.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.965+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:39:46.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:46.992+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:39:47.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.006+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:39:47.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.007+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:39:47.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.017+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:39:47.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.039+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:39:47.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.042+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:39:47.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.056+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:39:47.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.061+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:39:47.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.061+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:39:47.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.092+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:39:47.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.105+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:39:47.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.114+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:39:47.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.128+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:39:47.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.139+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:39:47.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.140+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:39:47.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.146+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:39:47.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.150+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:39:47.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.161+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:39:47.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.175+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:47.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.177+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:39:47.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.192+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:39:47.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.199+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:39:47.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.220+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:39:47.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.220+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:39:47.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.227+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:39:47.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.235+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:39:47.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.239+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:39:47.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.256+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:39:47.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.263+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:39:47.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.312+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:39:47.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.319+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:39:47.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.324+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:39:47.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.326+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:39:47.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.331+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:39:47.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.343+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:39:47.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.351+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:39:47.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:39:47.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.384+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:39:47.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.392+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:39:47.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.426+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:39:47.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.435+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:39:47.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.446+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:39:47.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.460+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:47.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.469+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:39:47.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.470+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:39:47.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.473+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:39:47.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.497+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:39:47.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.514+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:39:47.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.516+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:39:47.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.526+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:39:47.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.540+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:39:47.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.547+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:39:47.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.561+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:39:47.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.566+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:39:47.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.588+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:39:47.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.595+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:39:47.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:39:47.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.620+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:39:47.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.625+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:39:47.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.632+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:39:47.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.640+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:39:47.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.682+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:39:47.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.689+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:39:47.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.690+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:39:47.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.704+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:39:47.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.726+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:39:47.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.729+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:39:47.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.730+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:39:47.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.744+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:39:47.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 204 16 2774385 2774369 849.915 821.5 0.000679279 0.00116583 2024-09-17T16:39:47.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.760+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:47.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.761+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:39:47.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.766+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:39:47.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.799+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:39:47.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.804+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:39:47.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.806+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:39:47.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.807+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:47.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.821+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:39:47.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.837+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:39:47.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.854+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:39:47.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.863+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:39:47.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.870+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:39:47.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.895+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:39:47.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.896+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:39:47.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:39:47.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.910+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:39:47.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.910+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:39:47.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.927+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:39:47.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.934+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:39:47.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:39:47.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.975+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:39:47.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.977+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:39:47.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.983+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:39:47.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:47.992+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:39:48.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.002+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:39:48.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.028+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:39:48.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.043+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:39:48.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.045+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:39:48.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.070+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:39:48.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.076+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:39:48.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.097+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:39:48.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.101+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:39:48.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.108+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:39:48.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.122+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:39:48.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.143+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:39:48.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.146+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:48.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.149+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:39:48.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.156+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:39:48.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.164+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:39:48.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.173+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:39:48.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.190+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:39:48.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.210+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:39:48.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.210+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:39:48.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.233+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:39:48.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.237+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:39:48.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.256+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:39:48.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.259+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:39:48.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.270+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:39:48.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.286+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:39:48.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.307+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:39:48.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.308+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:39:48.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.325+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:39:48.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.351+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:39:48.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.361+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:39:48.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.365+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:39:48.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.371+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:39:48.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.373+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:39:48.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.382+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:39:48.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.391+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:39:48.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.399+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:39:48.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.400+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:39:48.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.427+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:39:48.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.430+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:39:48.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.468+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:39:48.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:39:48.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.486+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:39:48.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.500+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:39:48.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.516+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:39:48.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.542+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:39:48.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.555+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:39:48.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.561+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:39:48.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.568+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:39:48.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.571+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:39:48.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.579+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:39:48.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.585+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:39:48.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.610+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:39:48.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.619+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:39:48.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.631+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:39:48.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.645+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:39:48.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.663+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:39:48.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:39:48.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.682+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:39:48.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.687+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:39:48.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.709+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:39:48.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.710+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:39:48.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.716+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:39:48.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.738+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:39:48.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.748+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:39:48.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.749+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:39:48.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 205 16 2788233 2788217 849.991 865.5 0.00109465 0.00116572 2024-09-17T16:39:48.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.762+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:39:48.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.765+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:39:48.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.780+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:39:48.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.783+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:39:48.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.785+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:39:48.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.791+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:39:48.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.825+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:39:48.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.847+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:39:48.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.857+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:39:48.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.860+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:39:48.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.872+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:39:48.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.898+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:39:48.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.903+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:39:48.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.904+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:39:48.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.917+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:39:48.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.928+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:39:48.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.948+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:39:48.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:39:48.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.969+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:39:48.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.981+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:39:48.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:48.995+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:39:49.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.007+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:39:49.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.031+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:39:49.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.040+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:39:49.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.046+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:39:49.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.071+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:39:49.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.091+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:39:49.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.108+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:39:49.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.111+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:39:49.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.117+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:39:49.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.122+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:39:49.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.137+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:39:49.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.142+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:39:49.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.159+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:39:49.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.161+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:39:49.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.180+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:39:49.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.192+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:49.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.193+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:39:49.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.203+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:39:49.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:39:49.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.218+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:39:49.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.223+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:39:49.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.241+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:39:49.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.244+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:39:49.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.261+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:39:49.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.290+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:39:49.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.291+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:39:49.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.312+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:39:49.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.318+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:39:49.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.329+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:39:49.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.342+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:39:49.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.367+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:39:49.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.380+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:39:49.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.385+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:39:49.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.395+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:39:49.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.404+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:39:49.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.438+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:49.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.438+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:39:49.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.442+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:39:49.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.447+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:39:49.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.467+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:39:49.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.470+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:39:49.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.476+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:39:49.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.487+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:39:49.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.502+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:39:49.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.506+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:39:49.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.524+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:39:49.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.539+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:39:49.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.550+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:39:49.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.558+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:39:49.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.569+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:39:49.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.578+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:39:49.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.590+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:39:49.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.596+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:39:49.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.621+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:39:49.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.621+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:39:49.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.649+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:39:49.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.666+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:39:49.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.668+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:39:49.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.668+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:39:49.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.679+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:39:49.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.685+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:39:49.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.700+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:39:49.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.721+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:39:49.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.727+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:39:49.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.751+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:39:49.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 206 16 2802166 2802150 850.091 870.812 0.00065221 0.0011656 2024-09-17T16:39:49.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.753+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:39:49.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.753+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:39:49.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.765+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:39:49.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.766+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:39:49.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.779+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:39:49.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.794+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:39:49.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.797+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:39:49.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.826+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:39:49.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.833+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:39:49.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.835+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:39:49.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.853+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:39:49.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.855+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:39:49.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.865+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:49.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.875+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:39:49.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.886+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:39:49.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.909+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:39:49.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.923+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:39:49.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.935+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:39:49.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.937+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:39:49.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.937+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:39:49.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.975+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:39:49.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:49.994+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:39:50.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.001+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:39:50.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.005+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:39:50.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.026+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:39:50.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.029+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:39:50.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.041+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:39:50.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.052+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:39:50.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.056+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:39:50.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.070+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:39:50.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.072+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:39:50.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.082+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:39:50.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.094+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:39:50.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.111+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:39:50.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.126+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:39:50.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.129+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:39:50.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.137+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:39:50.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:39:50.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.169+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:39:50.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.184+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:39:50.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:39:50.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.208+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:39:50.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.217+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:39:50.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.230+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:39:50.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.235+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:39:50.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.247+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:39:50.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.254+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:39:50.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.262+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:39:50.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.270+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:39:50.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.282+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:39:50.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.300+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:39:50.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.318+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:39:50.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.340+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:39:50.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.345+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:39:50.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.351+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:39:50.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.354+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:39:50.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.391+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:39:50.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.401+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:39:50.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.403+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:39:50.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.420+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:39:50.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.438+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:39:50.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.441+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:39:50.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.461+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:39:50.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.468+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:39:50.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.480+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:39:50.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.493+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:39:50.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.502+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:39:50.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.504+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:39:50.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.518+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:39:50.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.563+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:39:50.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.567+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:39:50.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.580+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:39:50.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.581+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:39:50.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.590+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:39:50.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.610+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:39:50.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.615+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:39:50.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.653+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:39:50.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.659+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:39:50.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.681+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:39:50.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.684+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:39:50.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:39:50.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.715+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:39:50.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.715+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:39:50.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:39:50.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.739+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:39:50.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 207 16 2815699 2815683 850.07 845.812 0.000720211 0.00116559 2024-09-17T16:39:50.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.756+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:39:50.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.759+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:39:50.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.775+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:39:50.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.775+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:39:50.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.785+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:39:50.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.795+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:39:50.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.812+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:39:50.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.818+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:39:50.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.861+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:39:50.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.863+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:50.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.888+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:39:50.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.897+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:39:50.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.901+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:39:50.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.901+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:39:50.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.910+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:39:50.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.941+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:39:50.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.945+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:39:50.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.950+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:39:50.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.992+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:39:50.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.996+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:39:50.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:50.997+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:39:51.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.013+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:39:51.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.026+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:39:51.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.030+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:39:51.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.055+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:39:51.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.055+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:39:51.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.060+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:39:51.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.068+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:39:51.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.080+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:39:51.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:39:51.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.093+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:39:51.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.104+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:39:51.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.143+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:39:51.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.153+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:39:51.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.175+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:39:51.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.187+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:39:51.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.188+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:39:51.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.189+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:39:51.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.218+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:51.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.221+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:39:51.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.230+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:39:51.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.243+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:39:51.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.261+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:39:51.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.280+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:39:51.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.295+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:39:51.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.308+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:39:51.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.316+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:39:51.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.327+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:39:51.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.329+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:39:51.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.332+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:51.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.335+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:39:51.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.376+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:39:51.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.378+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:39:51.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.393+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:39:51.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.411+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:39:51.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.419+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:39:51.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.435+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:39:51.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.435+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:39:51.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:39:51.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.470+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:39:51.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.473+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:39:51.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.489+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:39:51.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.496+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:39:51.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.499+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:39:51.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.518+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:39:51.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.521+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:39:51.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.538+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:39:51.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.551+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:39:51.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.573+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:39:51.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.583+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:39:51.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.593+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:39:51.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.607+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:39:51.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.615+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:39:51.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.627+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:39:51.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.633+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:39:51.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.642+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:39:51.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.648+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:39:51.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.655+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:39:51.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.673+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:39:51.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.676+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:39:51.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.692+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:39:51.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.695+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:39:51.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.708+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:39:51.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.726+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:39:51.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 208 15 2829123 2829108 850.017 839.062 0.00173763 0.0011657 2024-09-17T16:39:51.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.753+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:39:51.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.764+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:39:51.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.767+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:39:51.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.769+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:39:51.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.781+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:39:51.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.787+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:39:51.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.806+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:39:51.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.807+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:39:51.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.831+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:39:51.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.856+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:39:51.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.865+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:39:51.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.882+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:39:51.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.887+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:39:51.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.887+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:39:51.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.905+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:39:51.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.918+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:39:51.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.918+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:39:51.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.926+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:39:51.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.929+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:39:51.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.955+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:39:51.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.961+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:39:51.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.965+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:39:51.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.971+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:39:51.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:51.995+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:39:52.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.002+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:39:52.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.013+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:39:52.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.026+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:39:52.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.044+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:39:52.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.061+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:39:52.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.072+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:39:52.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.082+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:39:52.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.083+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:39:52.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.094+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:39:52.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.102+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:39:52.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.107+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:39:52.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.124+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:39:52.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.134+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:39:52.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.143+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:39:52.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.163+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:39:52.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.182+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:39:52.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.190+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:39:52.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.206+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:39:52.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.219+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:39:52.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.237+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:39:52.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.239+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:39:52.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.253+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:39:52.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.254+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:39:52.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.258+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:39:52.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.266+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:39:52.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.267+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:39:52.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.275+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:39:52.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.315+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:39:52.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.319+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:39:52.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.335+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:39:52.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.354+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:39:52.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.362+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:39:52.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.365+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:39:52.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.366+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:39:52.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.368+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:39:52.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.390+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:39:52.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.392+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:39:52.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:39:52.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:39:52.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.451+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:39:52.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.456+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:39:52.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.473+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:39:52.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.479+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:39:52.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.497+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:39:52.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.502+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:52.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.508+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:39:52.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.513+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:39:52.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.537+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:39:52.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.551+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:39:52.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.555+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:39:52.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.579+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:39:52.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.584+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:39:52.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.602+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:39:52.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.608+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:39:52.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.613+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:39:52.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.621+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:39:52.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.625+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:39:52.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.628+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:39:52.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.647+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:39:52.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.655+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:39:52.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.662+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:39:52.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.689+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:39:52.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.696+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:39:52.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.697+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:39:52.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.707+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:39:52.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.722+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:39:52.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.746+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:39:52.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.746+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:39:52.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 209 16 2841994 2841978 849.798 804.375 0.000887824 0.001166 2024-09-17T16:39:52.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.777+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:39:52.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.777+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:39:52.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.807+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:39:52.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.815+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:39:52.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.822+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:39:52.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.840+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:39:52.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.843+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:39:52.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.848+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:39:52.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.868+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:39:52.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.868+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:39:52.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.887+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:39:52.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.912+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:39:52.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.921+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:39:52.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.940+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:39:52.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.954+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:39:52.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.955+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:39:52.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:39:52.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.970+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:39:52.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:52.986+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:39:53.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.000+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:39:53.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.005+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:39:53.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.008+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:39:53.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.018+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:39:53.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.032+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:39:53.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.069+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:39:53.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.073+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:39:53.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.089+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:39:53.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.093+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:39:53.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.095+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:39:53.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.107+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:39:53.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:39:53.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.128+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:39:53.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.138+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:39:53.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.144+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:39:53.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.152+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:39:53.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.167+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:39:53.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.178+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:39:53.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.206+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:39:53.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.223+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:39:53.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.230+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:39:53.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.233+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:39:53.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.261+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:39:53.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.278+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:39:53.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:39:53.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.297+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:39:53.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:39:53.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.324+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:39:53.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.334+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:39:53.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.353+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:39:53.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.374+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:39:53.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.377+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:39:53.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.383+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:39:53.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.388+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:39:53.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.409+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:53.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.428+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:39:53.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.438+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:39:53.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.453+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:39:53.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.464+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:39:53.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.466+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:39:53.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.468+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:39:53.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.478+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:39:53.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.480+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:39:53.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.500+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:39:53.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.514+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:39:53.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.517+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:39:53.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.525+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:39:53.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.535+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:39:53.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.544+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:39:53.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.572+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:39:53.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.572+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:39:53.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.585+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:39:53.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.590+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:39:53.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.598+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:39:53.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.609+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:39:53.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.641+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:39:53.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.650+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:39:53.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.657+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:39:53.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.658+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:39:53.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.659+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:39:53.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.689+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:39:53.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.700+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:39:53.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.700+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:39:53.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.705+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:39:53.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.715+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:39:53.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.749+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:39:53.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.751+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:39:53.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 210 16 2855673 2855657 849.822 854.938 0.00137589 0.00116597 2024-09-17T16:39:53.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.755+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:39:53.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.765+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:39:53.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.770+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:39:53.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.799+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:39:53.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.799+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:39:53.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.816+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:39:53.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.835+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:39:53.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.836+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:39:53.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.845+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:39:53.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.858+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:39:53.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.863+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:39:53.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.880+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:39:53.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.890+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:39:53.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.901+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:39:53.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.904+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:39:53.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.909+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:39:53.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.941+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:39:53.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.956+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:53.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:39:53.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.967+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:39:53.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.971+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:39:53.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.994+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:39:54.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.998+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:39:54.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:53.999+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:39:54.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.027+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:39:54.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.036+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:39:54.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.051+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:39:54.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.055+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:39:54.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.060+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:39:54.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.067+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:39:54.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.067+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:39:54.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.106+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:54.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.108+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:39:54.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.125+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:39:54.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.125+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:39:54.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.141+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:39:54.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.152+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:39:54.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.157+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:39:54.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.173+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:39:54.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.175+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:39:54.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.178+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:39:54.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.210+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:39:54.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:39:54.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.237+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:39:54.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.240+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:54.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.261+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:39:54.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.270+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:39:54.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.280+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:39:54.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.296+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:39:54.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.296+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:39:54.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.296+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:39:54.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.313+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:39:54.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.318+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:39:54.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.343+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:39:54.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.350+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:39:54.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.359+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:39:54.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.362+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:39:54.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.383+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:39:54.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.393+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:39:54.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.397+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:39:54.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.408+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:39:54.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.409+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:39:54.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.421+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:39:54.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.434+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:39:54.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.442+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:39:54.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.461+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:39:54.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.487+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:39:54.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.500+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:39:54.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.503+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:39:54.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.506+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:39:54.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.533+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:39:54.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.546+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:39:54.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.574+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:39:54.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.583+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:39:54.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.615+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:39:54.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.626+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:39:54.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.628+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:39:54.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.642+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:39:54.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.648+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:39:54.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.705+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:39:54.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.723+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:39:54.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.731+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:39:54.755 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 211 15 2869517 2869502 849.896 865.312 0.000624835 0.00116587 2024-09-17T16:39:54.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.762+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:39:54.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.773+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:39:54.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.780+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:39:54.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.782+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:39:54.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.797+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:39:54.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.812+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:39:54.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.829+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:39:54.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.842+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:39:54.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.842+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:39:54.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.852+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:39:54.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:39:54.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.865+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:39:54.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.875+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:39:54.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.893+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:39:54.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.903+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:39:54.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.926+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:39:54.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.947+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:39:54.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.953+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:39:54.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:39:54.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.964+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:39:54.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:54.965+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:39:55.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.007+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:55.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.018+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:39:55.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.039+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:39:55.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.040+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:39:55.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.041+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:39:55.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.060+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:39:55.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.066+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:39:55.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.089+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:39:55.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.116+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:39:55.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.118+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:39:55.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.137+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:39:55.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.150+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:39:55.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.167+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:39:55.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.184+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:39:55.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:39:55.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.221+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:39:55.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.228+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:39:55.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.231+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:39:55.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.247+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:39:55.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.256+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:39:55.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.264+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:39:55.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.267+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:39:55.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.282+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:39:55.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.297+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:39:55.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.301+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:39:55.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.317+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:39:55.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.324+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:39:55.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.335+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:39:55.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.339+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:39:55.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.347+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:39:55.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:39:55.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.384+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:39:55.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.419+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:39:55.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.429+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:39:55.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.430+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:39:55.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.433+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:39:55.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.451+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:39:55.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.451+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:39:55.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.460+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:39:55.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.520+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:39:55.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 212 16 2879920 2879904 848.953 650.125 0.000457999 0.00116597 2024-09-17T16:39:55.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.762+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:39:55.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.763+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:39:55.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.765+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:39:55.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.767+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:39:55.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.786+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:39:55.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.789+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:39:55.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.825+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:39:55.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.843+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:39:55.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.844+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:39:55.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.862+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:39:55.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.882+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:39:55.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.892+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:39:55.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.901+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:39:55.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.909+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:39:55.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.912+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:39:55.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.920+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:39:55.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.943+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:39:55.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.957+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:39:55.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.969+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:39:55.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.982+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:55.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:55.986+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:39:56.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.005+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:39:56.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.015+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:39:56.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.025+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:39:56.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.029+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:56.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.060+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:39:56.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.075+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:39:56.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.080+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:39:56.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.090+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:39:56.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.091+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:39:56.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.094+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:39:56.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.099+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:39:56.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.134+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:39:56.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.135+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:39:56.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.148+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:39:56.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.153+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:39:56.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.167+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:39:56.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.178+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:39:56.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.186+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:39:56.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.213+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:39:56.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.229+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:39:56.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.239+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:39:56.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.246+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:39:56.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.257+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:39:56.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.293+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:39:56.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.311+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:39:56.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.311+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:39:56.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.323+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:39:56.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.324+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:39:56.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.329+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:39:56.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.336+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:39:56.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.366+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:39:56.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.384+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:39:56.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.390+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:39:56.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.406+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:39:56.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.408+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:39:56.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.422+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:39:56.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.438+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:39:56.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.447+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:39:56.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.461+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:39:56.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.468+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:39:56.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.478+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:39:56.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.494+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:39:56.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.505+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:39:56.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.515+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:39:56.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.522+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:39:56.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.523+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:39:56.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.524+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:39:56.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.541+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:39:56.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.565+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:39:56.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.578+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:39:56.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.605+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:39:56.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.612+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:39:56.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.613+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:39:56.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.618+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:39:56.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.622+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:39:56.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.639+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:39:56.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.641+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:39:56.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.660+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:39:56.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.664+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:39:56.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.677+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:39:56.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.685+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:39:56.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.707+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:39:56.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.725+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:39:56.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.729+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:39:56.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.737+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:39:56.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 213 15 2893822 2893807 849.046 868.938 0.00124427 0.00116704 2024-09-17T16:39:56.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.757+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:39:56.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.766+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:39:56.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.776+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:39:56.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.798+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:39:56.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.800+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:39:56.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.825+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:39:56.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.845+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:39:56.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.847+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:39:56.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.854+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:39:56.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.862+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:39:56.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.867+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:39:56.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.871+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:39:56.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.888+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:39:56.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.895+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:39:56.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.899+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:39:56.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:39:56.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.928+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:39:56.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.953+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:39:56.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.954+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:39:56.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.956+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:39:56.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.966+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:39:56.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.978+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:39:57.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:56.998+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:39:57.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:39:57.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:39:57.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.026+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:39:57.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.042+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:39:57.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.045+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:39:57.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.066+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:39:57.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.077+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:39:57.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.097+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:39:57.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.119+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:39:57.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.125+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:39:57.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.128+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:39:57.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.136+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:39:57.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.146+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:39:57.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.149+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:39:57.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.181+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:39:57.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.186+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:39:57.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.187+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:39:57.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.207+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:39:57.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:39:57.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.229+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:39:57.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.230+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:39:57.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.236+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:39:57.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.267+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:39:57.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.268+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:39:57.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.278+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:39:57.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.286+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:39:57.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.299+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:39:57.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.302+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:39:57.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:39:57.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.314+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:39:57.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:39:57.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.324+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:39:57.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.364+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:39:57.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.368+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:39:57.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.378+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:39:57.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.384+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:39:57.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.414+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:39:57.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.419+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:39:57.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:39:57.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.464+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:39:57.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.479+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:39:57.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.482+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:39:57.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.504+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:39:57.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.513+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:39:57.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.522+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:39:57.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.527+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:39:57.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.545+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:39:57.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.550+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:39:57.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.550+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:39:57.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.551+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:39:57.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.572+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:39:57.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.574+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:39:57.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.595+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:39:57.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.606+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:39:57.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.613+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:39:57.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.629+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:39:57.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.630+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:39:57.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.645+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:39:57.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.654+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:39:57.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.654+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:39:57.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.667+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:39:57.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.691+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:39:57.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.701+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:39:57.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.706+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:39:57.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.715+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:39:57.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.725+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:39:57.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.733+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:39:57.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.745+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:39:57.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 214 15 2907333 2907318 849.024 844.438 0.00066665 0.00116706 2024-09-17T16:39:57.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.754+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:39:57.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.758+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:39:57.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.786+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:39:57.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.790+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:39:57.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.807+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:39:57.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:39:57.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.831+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:39:57.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.850+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:39:57.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:39:57.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.851+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:39:57.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.872+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:39:57.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.874+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:39:57.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.895+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:39:57.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.897+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:39:57.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.911+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:39:57.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.939+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:39:57.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.941+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:39:57.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.945+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:39:57.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.954+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:39:57.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.981+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:39:57.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:57.981+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:39:58.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.004+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:39:58.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.005+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:39:58.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.015+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:39:58.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.026+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:39:58.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.037+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:39:58.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.038+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:39:58.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.048+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:39:58.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.069+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:39:58.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.097+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:39:58.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.099+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:39:58.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.111+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:39:58.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.145+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:39:58.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.167+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:39:58.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.183+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:39:58.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.184+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:39:58.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.185+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:39:58.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:39:58.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.204+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:39:58.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.226+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:58.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.235+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:39:58.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.245+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:39:58.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.273+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:39:58.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:39:58.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.292+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:39:58.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.298+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:39:58.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.323+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:39:58.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.341+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:39:58.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.350+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:39:58.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.356+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:39:58.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.357+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:39:58.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:39:58.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.371+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:39:58.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.375+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:39:58.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.387+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:39:58.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.407+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:39:58.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.416+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:39:58.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.442+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:39:58.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.445+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:39:58.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.450+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:39:58.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.463+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:39:58.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.470+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:39:58.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.476+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:39:58.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.476+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:39:58.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.506+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:39:58.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.527+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:39:58.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.528+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:39:58.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.541+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:39:58.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.563+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:39:58.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.575+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:39:58.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.586+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:39:58.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.588+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:39:58.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.597+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:39:58.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:39:58.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.632+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:39:58.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.655+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:39:58.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.656+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:39:58.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.676+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:39:58.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.683+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:39:58.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.685+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:39:58.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.688+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:39:58.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.719+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:39:58.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.728+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:39:58.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.728+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:39:58.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.737+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:39:58.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.742+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:39:58.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 215 15 2921072 2921057 849.069 858.688 0.000608824 0.001167 2024-09-17T16:39:58.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.765+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:39:58.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.783+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:39:58.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.783+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:39:58.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.783+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:39:58.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.788+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:39:58.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.797+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:39:58.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.811+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:39:58.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.831+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:39:58.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.834+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:39:58.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.853+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:39:58.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.876+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:39:58.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.908+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:39:58.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.913+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:39:58.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.916+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:39:58.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.940+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:39:58.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.950+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:39:58.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.953+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:39:58.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.955+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:39:58.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.972+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:39:58.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.980+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:39:58.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:58.987+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:39:59.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.002+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:39:59.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.034+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:39:59.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.043+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:39:59.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.054+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:39:59.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.065+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:39:59.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.080+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:39:59.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:39:59.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.091+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:39:59.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.108+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:39:59.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.119+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:39:59.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.148+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:39:59.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.155+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:39:59.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.159+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:39:59.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.193+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:39:59.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.196+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:39:59.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.228+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:39:59.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.233+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:39:59.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.239+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:39:59.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.239+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:39:59.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.256+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:39:59.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:39:59.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.265+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:39:59.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.298+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:39:59.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.305+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:39:59.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.306+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:39:59.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.313+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:39:59.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.315+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:39:59.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.356+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:39:59.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.360+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:39:59.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.373+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:39:59.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.375+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:39:59.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.379+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:39:59.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:39:59.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.419+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:39:59.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.420+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:39:59.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.440+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:39:59.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.449+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:39:59.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.451+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:39:59.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.484+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:39:59.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.486+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:39:59.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.495+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:39:59.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.507+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:39:59.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.512+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:39:59.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.517+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:39:59.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.533+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:39:59.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.558+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:39:59.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.566+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:39:59.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.574+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:39:59.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.587+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:39:59.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.592+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:39:59.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.593+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:39:59.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.607+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:39:59.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.634+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:39:59.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.642+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:39:59.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.656+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:39:59.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.658+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:39:59.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.664+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:39:59.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.687+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:39:59.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.704+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:39:59.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.714+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:39:59.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.719+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:39:59.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.723+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:39:59.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.741+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:39:59.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.746+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:39:59.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 216 16 2934809 2934793 849.112 858.5 0.000744999 0.00116694 2024-09-17T16:39:59.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.760+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:39:59.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.776+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:39:59.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.778+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:39:59.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.787+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:39:59.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.796+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:39:59.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:39:59.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:39:59.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.821+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:39:59.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.828+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:39:59.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.848+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:39:59.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.852+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:39:59.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.859+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:39:59.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.869+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:39:59.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.888+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:39:59.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.895+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:39:59.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.922+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:39:59.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.922+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:39:59.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.922+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:39:59.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.927+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:39:59.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.957+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:39:59.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.962+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:39:59.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.966+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:39:59.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:39:59.996+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:00.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.006+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:40:00.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.022+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:40:00.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.024+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:40:00.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.039+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:40:00.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.051+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:40:00.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.062+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:40:00.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.065+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:40:00.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.066+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:40:00.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.102+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:40:00.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.102+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:40:00.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.115+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:40:00.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.122+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:40:00.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.138+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:40:00.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.144+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:40:00.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.146+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:40:00.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.154+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:40:00.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.164+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:40:00.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.166+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:40:00.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.199+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:40:00.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.212+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:40:00.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.228+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:40:00.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.230+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:40:00.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.255+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:40:00.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.257+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:40:00.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.258+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:40:00.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.282+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:40:00.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.291+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:40:00.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.317+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:40:00.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.329+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:40:00.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.336+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:40:00.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.344+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:40:00.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.356+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:40:00.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.367+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:40:00.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.372+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:40:00.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.376+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:40:00.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.379+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:40:00.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.398+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:40:00.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.403+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:40:00.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.405+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:40:00.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.436+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:40:00.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.454+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:40:00.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.469+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:40:00.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.475+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:40:00.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.499+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:40:00.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.503+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:40:00.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.509+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:40:00.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.544+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:40:00.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.551+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:40:00.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.564+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:40:00.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.605+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:40:00.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.610+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:40:00.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:40:00.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.667+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:40:00.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.691+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:40:00.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.691+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:40:00.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.698+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:40:00.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.713+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:40:00.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.725+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:40:00.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.732+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:40:00.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.741+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:40:00.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 217 16 2948542 2948526 849.154 858.312 0.0021007 0.00116688 2024-09-17T16:40:00.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.764+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:40:00.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.771+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:40:00.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.772+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:40:00.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.778+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:40:00.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.798+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:40:00.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.812+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:40:00.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.812+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:40:00.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.814+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:40:00.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.845+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:40:00.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.859+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:40:00.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.870+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:40:00.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.871+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:00.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.885+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:40:00.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.897+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:40:00.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.901+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:40:00.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.905+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:40:00.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.908+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:00.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.914+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:40:00.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.919+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:40:00.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.929+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:40:00.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.938+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:40:00.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.955+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:40:00.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.964+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:40:00.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:00.981+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:40:01.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.005+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:40:01.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.015+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:40:01.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.023+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:40:01.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.028+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:40:01.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.033+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:40:01.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.050+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:40:01.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.071+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:40:01.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.077+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:40:01.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.088+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:40:01.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.122+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:40:01.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.129+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:40:01.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.132+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:40:01.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.137+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:40:01.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.138+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:40:01.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.146+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:40:01.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.159+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:40:01.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.189+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:40:01.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.196+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:40:01.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.207+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:40:01.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.214+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:40:01.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.221+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:40:01.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.228+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:40:01.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.235+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:40:01.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.235+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:40:01.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.247+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:40:01.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.276+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:40:01.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.283+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:40:01.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.312+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:40:01.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.321+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:40:01.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.342+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:40:01.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.351+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:40:01.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.361+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:40:01.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.366+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:40:01.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.372+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:40:01.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.389+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:40:01.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.390+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:40:01.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.419+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:40:01.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.424+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:01.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.439+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:40:01.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.439+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:40:01.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.441+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:40:01.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.454+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:40:01.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.456+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:40:01.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.474+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:40:01.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.490+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:40:01.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.503+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:40:01.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.518+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:40:01.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.519+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:40:01.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.527+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:40:01.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.549+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:40:01.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.562+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:40:01.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.568+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:40:01.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.589+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:40:01.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.615+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:01.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.630+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:40:01.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.636+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:40:01.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.637+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:40:01.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.638+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:40:01.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.662+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:40:01.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.699+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:01.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.714+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:40:01.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.721+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:40:01.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.732+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:40:01.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.739+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:40:01.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.742+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:40:01.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 218 16 2961873 2961857 849.08 833.188 0.00102637 0.00116698 2024-09-17T16:40:01.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.757+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:40:01.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.764+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:40:01.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.781+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:40:01.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.782+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:40:01.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.794+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:40:01.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.811+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:40:01.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.816+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:40:01.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.825+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:40:01.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.832+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:40:01.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.922+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:01.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.936+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:40:01.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.940+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:40:01.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.953+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:40:01.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.956+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:40:01.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.957+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:40:01.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.982+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:40:01.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.985+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:40:02.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:01.997+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:40:02.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.016+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:40:02.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.024+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:40:02.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.029+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:40:02.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.033+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:40:02.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.043+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:40:02.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.065+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:40:02.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:40:02.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.078+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:40:02.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.078+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:40:02.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.083+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:40:02.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.098+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:02.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.109+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:40:02.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.118+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:40:02.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.140+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:40:02.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.144+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:02.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.148+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:40:02.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.148+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:40:02.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.167+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:40:02.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.180+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:40:02.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.189+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:40:02.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.200+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:40:02.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.213+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:40:02.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.217+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:40:02.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.217+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:40:02.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.244+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:40:02.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.251+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:40:02.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.265+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:40:02.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.271+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:40:02.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:40:02.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.289+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:40:02.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.317+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:40:02.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.324+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:40:02.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.346+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:40:02.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.347+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:40:02.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.350+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:40:02.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.353+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:40:02.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.380+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:40:02.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:40:02.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.411+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:02.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.416+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:40:02.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.423+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:40:02.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.441+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:40:02.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.447+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:40:02.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.452+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:02.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.468+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:40:02.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.471+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:40:02.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.489+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:40:02.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.494+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:40:02.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.501+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:40:02.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.514+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:40:02.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.520+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:40:02.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.538+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:40:02.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.565+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:40:02.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.568+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:40:02.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.571+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:40:02.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.589+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:40:02.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.592+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:40:02.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.601+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:40:02.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.613+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:40:02.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.631+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:40:02.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.636+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:40:02.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.642+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:40:02.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:40:02.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.688+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:40:02.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.706+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:40:02.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.727+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:40:02.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.727+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:40:02.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.737+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:02.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 219 16 2974261 2974245 848.738 774.25 0.00072828 0.00116747 2024-09-17T16:40:02.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.760+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:40:02.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.778+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:40:02.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.780+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:40:02.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.793+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:40:02.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.798+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:40:02.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.827+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:40:02.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.832+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:40:02.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.833+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:40:02.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:40:02.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.854+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:40:02.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.873+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:40:02.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.874+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:40:02.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.885+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:40:02.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.903+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:40:02.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.905+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:40:02.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.933+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:40:02.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.937+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:40:02.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.950+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:40:02.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.952+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:40:02.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.952+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:40:02.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.958+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:40:02.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.970+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:40:02.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.991+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:40:02.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:02.996+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:40:03.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.007+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:40:03.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.012+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:40:03.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.027+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:40:03.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.030+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:40:03.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.036+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:40:03.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.061+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:40:03.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.062+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:40:03.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.066+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:40:03.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.075+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:40:03.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.085+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:40:03.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.093+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:40:03.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.096+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:40:03.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.114+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:40:03.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.136+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:40:03.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.137+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:40:03.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.152+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:40:03.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.166+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:40:03.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.173+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:40:03.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.175+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:40:03.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.228+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:40:03.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.231+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:40:03.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.249+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:40:03.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.249+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:40:03.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.264+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:40:03.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.264+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:40:03.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.285+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:40:03.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:40:03.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.296+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:40:03.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.355+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:40:03.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.375+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:40:03.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.378+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:40:03.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.379+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:03.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.394+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:40:03.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.406+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:40:03.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.417+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:40:03.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.422+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:40:03.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.422+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:40:03.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.423+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:40:03.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.437+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:40:03.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.445+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:40:03.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.470+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:40:03.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.478+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:40:03.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:40:03.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.511+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:40:03.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.532+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:40:03.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.534+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:40:03.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.560+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:40:03.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.567+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:40:03.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.572+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:40:03.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.585+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:40:03.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.591+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:40:03.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.610+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:40:03.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.614+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:40:03.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.621+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:40:03.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.638+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:40:03.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.646+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:40:03.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.647+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:03.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.656+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:40:03.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.673+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:40:03.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.678+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:40:03.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.692+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:40:03.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.695+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:40:03.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.696+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:40:03.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.705+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:40:03.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.731+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:40:03.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.734+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:40:03.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.735+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:40:03.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:40:03.755603+0000 min lat: 0.000227768 max lat: 0.222415 avg lat: 0.00116744 2024-09-17T16:40:03.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:40:03.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 220 16 2987856 2987840 848.742 849.688 0.000749118 0.00116744 2024-09-17T16:40:03.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.758+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:40:03.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.778+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:40:03.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.811+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:40:03.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.812+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:40:03.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.823+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:40:03.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.824+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:40:03.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.824+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:40:03.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.839+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:40:03.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:40:03.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.858+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:40:03.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.865+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:40:03.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.875+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:40:03.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.887+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:40:03.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.924+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:40:03.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.936+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:40:03.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.939+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:03.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.954+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:40:03.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:03.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.978+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:40:03.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:03.978+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:40:04.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:40:04.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.009+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:40:04.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.021+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:40:04.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.025+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:04.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.027+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:40:04.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.037+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:04.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.046+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:40:04.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.080+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:40:04.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.090+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:40:04.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.100+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:40:04.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.112+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:40:04.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.115+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:40:04.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.128+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:40:04.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.130+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:40:04.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.134+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:40:04.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.154+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:40:04.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.162+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:40:04.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:04.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:40:04.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.217+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:40:04.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.247+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:40:04.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.249+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:40:04.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.269+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:40:04.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.273+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:40:04.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.282+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:40:04.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.313+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:40:04.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.327+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:40:04.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:40:04.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.342+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:04.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.358+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:40:04.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.381+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:40:04.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.384+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:40:04.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.409+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:40:04.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.414+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:40:04.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.429+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:40:04.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.436+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:40:04.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.446+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:40:04.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.450+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:40:04.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.468+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:40:04.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.477+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:40:04.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.493+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:40:04.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.506+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:40:04.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.516+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:40:04.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.519+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:40:04.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.529+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:40:04.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.534+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:40:04.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.571+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:40:04.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.578+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:40:04.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.587+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:40:04.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.613+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:04.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.626+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:40:04.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.626+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:40:04.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.631+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:40:04.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.647+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:04.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.665+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:40:04.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.665+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:04.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.668+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:40:04.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.682+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:40:04.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.687+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:40:04.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.697+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:40:04.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.719+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:40:04.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.735+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:40:04.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.740+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:40:04.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 221 16 3001919 3001903 848.878 878.938 0.000666821 0.00116727 2024-09-17T16:40:04.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.757+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:40:04.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.759+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:40:04.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.761+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:40:04.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.770+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:40:04.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.772+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:40:04.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.779+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:04.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.808+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:40:04.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.810+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:40:04.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.834+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:40:04.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.852+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:40:04.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.862+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:04.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.870+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:40:04.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.872+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:04.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.889+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:40:04.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.904+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:40:04.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.910+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:40:04.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.912+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:04.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.948+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:40:04.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.970+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:40:04.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:04.997+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:40:05.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.010+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:40:05.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.018+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:40:05.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.027+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:40:05.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.033+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:40:05.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.041+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:40:05.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.062+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:40:05.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.078+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:40:05.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.079+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:40:05.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.090+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:05.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.102+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:40:05.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.105+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:40:05.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.127+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:40:05.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:40:05.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.142+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:40:05.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:40:05.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.176+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:40:05.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.189+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:40:05.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.196+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:40:05.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.198+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:40:05.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.207+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:40:05.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.227+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:40:05.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.239+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:40:05.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.240+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:40:05.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.245+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:40:05.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.276+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:40:05.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.294+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:40:05.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.294+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:40:05.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.297+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:40:05.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.314+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:40:05.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.338+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:40:05.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.341+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:40:05.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.368+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:40:05.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.380+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:40:05.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.384+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:40:05.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.391+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:40:05.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.409+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:40:05.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.418+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:40:05.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.446+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:40:05.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.449+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:40:05.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.476+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:40:05.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.477+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:40:05.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.501+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:40:05.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.600+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:40:05.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.604+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:40:05.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.606+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:40:05.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.632+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:40:05.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.633+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:40:05.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.648+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:40:05.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.657+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:40:05.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.669+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:40:05.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.689+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:40:05.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.696+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:40:05.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.724+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:40:05.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.725+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:40:05.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.747+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:40:05.756 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 222 16 3014694 3014678 848.651 798.438 0.000849417 0.00116759 2024-09-17T16:40:05.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.769+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:40:05.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.782+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:40:05.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.788+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:40:05.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.801+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:40:05.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:40:05.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.812+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:40:05.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.820+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:40:05.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.834+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:40:05.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.840+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:40:05.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.846+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:05.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.865+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:40:05.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.879+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:05.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:40:05.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.900+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:40:05.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.907+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:40:05.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.913+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:40:05.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.929+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:40:05.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.943+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:40:05.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.948+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:40:05.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.951+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:40:05.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:40:05.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.977+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:40:05.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:05.992+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:40:06.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.022+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:40:06.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.025+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:40:06.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.028+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:40:06.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.032+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:06.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.052+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:40:06.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.062+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:40:06.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.065+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:40:06.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.071+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:40:06.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.082+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:40:06.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.083+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:40:06.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.099+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:40:06.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.100+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:40:06.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.126+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:40:06.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:40:06.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.147+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:40:06.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.147+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:40:06.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.159+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:40:06.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.186+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:40:06.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.188+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:40:06.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.201+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:40:06.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.203+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:40:06.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.210+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:40:06.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.233+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:40:06.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.238+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:40:06.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.243+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:40:06.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.256+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:06.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:40:06.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.295+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:40:06.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.310+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:40:06.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.312+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:40:06.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.325+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:40:06.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.330+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:40:06.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.335+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:40:06.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.341+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:40:06.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.371+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:40:06.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.377+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:40:06.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:40:06.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.393+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:40:06.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.411+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:40:06.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.416+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:40:06.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.437+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:40:06.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.442+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:40:06.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.455+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:40:06.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.460+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:40:06.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.492+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:40:06.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.502+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:40:06.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.507+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:40:06.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.531+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:40:06.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.533+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:40:06.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.545+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:40:06.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.563+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:40:06.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.569+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:06.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.596+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:40:06.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.614+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:40:06.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.626+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:40:06.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.632+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:40:06.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.651+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:40:06.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.656+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:40:06.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.662+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:40:06.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.694+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:40:06.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.697+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:40:06.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.712+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:40:06.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.718+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:06.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.721+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:40:06.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.734+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:40:06.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.742+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:40:06.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.748+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:40:06.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 223 16 3028478 3028462 848.708 861.5 0.000618691 0.0011675 2024-09-17T16:40:06.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.765+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:40:06.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.769+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:40:06.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.773+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:40:06.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.787+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:40:06.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.797+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:40:06.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.804+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:40:06.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.812+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:40:06.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.821+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:40:06.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.866+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:40:06.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.867+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:40:06.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.870+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:40:06.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.881+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:40:06.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.929+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:40:06.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.930+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:40:06.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.965+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:40:06.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.968+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:40:06.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:06.975+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:40:07.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.012+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:40:07.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.026+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:07.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.030+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:40:07.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.031+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:40:07.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.042+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:40:07.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:40:07.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.055+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:40:07.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.081+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:40:07.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.086+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:40:07.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.099+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:40:07.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.120+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:07.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.132+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:40:07.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.136+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:40:07.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.140+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:07.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.150+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:40:07.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:40:07.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.168+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:40:07.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.173+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:40:07.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.183+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:40:07.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.221+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:40:07.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.226+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:40:07.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.249+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:40:07.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.250+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:40:07.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.256+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:40:07.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.263+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:40:07.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:40:07.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.303+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:07.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.311+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:07.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.311+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:40:07.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.339+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:40:07.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.343+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:40:07.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.350+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:40:07.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.355+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:40:07.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.382+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:07.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.389+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:40:07.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.392+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:40:07.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.412+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:40:07.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.422+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:40:07.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.422+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:40:07.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.429+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:40:07.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.443+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:40:07.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.462+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:40:07.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.471+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:40:07.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.479+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:40:07.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.493+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:40:07.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.493+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:40:07.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.502+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:40:07.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.523+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:40:07.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.596+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:40:07.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.611+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:40:07.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.617+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:40:07.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.627+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:40:07.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.640+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:40:07.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.642+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:40:07.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.647+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:40:07.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.661+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:40:07.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.671+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:40:07.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.688+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:40:07.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.696+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:40:07.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.711+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:40:07.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.721+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:40:07.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.721+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:40:07.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.726+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:40:07.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.746+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:40:07.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.749+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:40:07.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.753+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:40:07.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 224 16 3040906 3040890 848.386 776.75 0.000672452 0.00116795 2024-09-17T16:40:07.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.774+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:40:07.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.775+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:40:07.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.786+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:40:07.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.793+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:40:07.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:40:07.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.817+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:40:07.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.854+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:40:07.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.856+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:40:07.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.870+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:40:07.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.889+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:40:07.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.890+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:40:07.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.904+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:40:07.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.916+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:40:07.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.919+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:40:07.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.929+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:40:07.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.956+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:40:07.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.959+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:40:07.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.959+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:40:07.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.972+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:40:07.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.978+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:40:07.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:07.985+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:40:08.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.000+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:40:08.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.001+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:40:08.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.033+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:40:08.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.035+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:40:08.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.067+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:40:08.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.067+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:40:08.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.091+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:40:08.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.095+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:40:08.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.117+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:40:08.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.126+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:40:08.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.130+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:40:08.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.142+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:40:08.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.143+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:40:08.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.162+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:40:08.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.163+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:40:08.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.170+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:40:08.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.187+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:40:08.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.206+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:40:08.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.212+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:40:08.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.225+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:40:08.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.240+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:40:08.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.348+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:40:08.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.351+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:40:08.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.364+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:40:08.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.378+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:40:08.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:40:08.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.392+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:40:08.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.404+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:40:08.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.427+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:40:08.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.427+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:40:08.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.430+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:40:08.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.446+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:40:08.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:40:08.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.471+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:40:08.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.483+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:40:08.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.493+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:40:08.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.508+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:40:08.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.519+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:40:08.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.527+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:40:08.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.544+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:40:08.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.551+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:40:08.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.553+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:40:08.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.579+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:40:08.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.581+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:40:08.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.590+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:40:08.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.600+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:40:08.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.607+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:40:08.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.609+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:40:08.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.623+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:40:08.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.647+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:40:08.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.666+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:40:08.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.677+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:40:08.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.683+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:40:08.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.703+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:40:08.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.737+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:40:08.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.739+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:40:08.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 225 16 3053490 3053474 848.11 786.5 0.000676009 0.00116834 2024-09-17T16:40:08.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.763+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:40:08.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.763+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:40:08.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.773+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:40:08.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.781+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:40:08.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.799+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:40:08.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.810+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:40:08.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.831+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:40:08.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.838+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:40:08.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.853+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:40:08.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.872+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:40:08.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.879+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:40:08.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.894+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:40:08.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.918+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:40:08.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.945+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:40:08.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.958+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:40:08.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.965+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:40:08.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.967+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:40:08.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.978+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:08.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.981+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:40:09.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:08.998+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:09.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.023+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:40:09.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.051+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:40:09.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.094+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:40:09.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.110+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:40:09.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.115+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:40:09.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.124+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:40:09.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.126+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:40:09.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.136+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:40:09.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:40:09.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.158+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:40:09.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.165+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:40:09.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.190+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:09.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.195+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:40:09.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.205+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:40:09.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.206+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:40:09.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.209+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:40:09.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:40:09.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.238+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:40:09.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.238+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:40:09.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.257+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:40:09.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.288+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:40:09.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.289+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:40:09.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.295+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:40:09.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.296+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:40:09.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.313+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:40:09.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.316+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:40:09.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.318+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:40:09.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.349+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:40:09.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.359+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:40:09.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.360+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:40:09.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:40:09.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.394+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:40:09.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.407+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:40:09.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.413+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:40:09.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.425+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:40:09.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.462+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:40:09.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.470+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:40:09.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:40:09.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.500+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:40:09.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.501+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:40:09.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.502+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:40:09.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.508+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:40:09.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.524+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:40:09.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.535+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:40:09.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.546+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:40:09.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.551+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:40:09.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.575+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:40:09.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.577+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:09.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.588+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:40:09.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.597+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:40:09.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.606+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:40:09.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:40:09.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.669+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:40:09.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.672+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:40:09.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.673+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:40:09.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.674+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:40:09.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.701+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:40:09.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.709+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:40:09.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.737+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:40:09.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.737+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:40:09.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 226 16 3067111 3067095 848.124 851.312 0.000945619 0.00116832 2024-09-17T16:40:09.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.758+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:40:09.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.759+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:40:09.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.773+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:40:09.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.788+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:40:09.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.811+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:40:09.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.828+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:09.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.832+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:40:09.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.837+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:40:09.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.846+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:40:09.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.889+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:40:09.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.897+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:40:09.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.904+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:40:09.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.905+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:40:09.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.905+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:40:09.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.917+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:40:09.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.924+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:40:09.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.957+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:40:09.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.959+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:40:09.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.973+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:40:09.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.979+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:40:09.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:09.990+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:40:10.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.024+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:40:10.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.038+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:40:10.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.043+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:40:10.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.045+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:40:10.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.045+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:10.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:40:10.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.099+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:40:10.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.106+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:40:10.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.122+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:40:10.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.124+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:40:10.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.128+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:40:10.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.131+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:40:10.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.133+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:40:10.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.164+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:40:10.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.174+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:40:10.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.180+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:40:10.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.185+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:40:10.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.205+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:10.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.205+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:40:10.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.234+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:40:10.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.236+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:40:10.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.265+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:40:10.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.267+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:40:10.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.278+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:40:10.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.285+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:40:10.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.301+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:40:10.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.304+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:40:10.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.311+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:10.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.311+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:40:10.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.327+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:40:10.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.360+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:40:10.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.378+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:40:10.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.378+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:40:10.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.392+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:40:10.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.409+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:40:10.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.414+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:40:10.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.428+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:40:10.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.429+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:40:10.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.447+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:40:10.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.461+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:40:10.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.467+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:40:10.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.489+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:40:10.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.496+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:40:10.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.499+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:40:10.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.503+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:40:10.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.515+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:40:10.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.515+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:40:10.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.541+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:40:10.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.553+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:40:10.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.601+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:40:10.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.608+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:40:10.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.617+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:40:10.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.628+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:40:10.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.659+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:40:10.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.662+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:40:10.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.676+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:40:10.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.686+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:40:10.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.688+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:40:10.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.712+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:40:10.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.714+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:40:10.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:40:10.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.721+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:40:10.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.747+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:40:10.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.754+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:10.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 227 16 3079961 3079945 847.925 803.125 0.000661145 0.00116859 2024-09-17T16:40:10.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.798+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:10.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.829+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:40:10.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.868+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:40:10.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.869+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:10.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:40:10.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.910+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:40:10.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.913+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:40:10.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.931+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:40:10.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.936+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:10.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.954+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:40:10.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:10.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.981+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:40:10.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.982+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:40:10.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:10.992+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:40:11.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.005+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:40:11.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.022+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:40:11.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.029+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:40:11.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.052+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:40:11.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.069+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:40:11.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.070+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:40:11.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.076+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:40:11.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.108+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:11.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.112+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:40:11.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.129+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:40:11.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.135+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:40:11.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.145+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:40:11.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.155+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:40:11.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.172+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:11.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.182+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:40:11.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.183+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:40:11.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.189+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:40:11.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:40:11.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.226+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:40:11.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.238+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:40:11.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.250+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:40:11.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.266+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:40:11.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.273+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:40:11.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.295+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:40:11.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.298+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:40:11.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.303+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:40:11.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.335+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:40:11.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.358+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:40:11.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.362+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:11.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.363+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:40:11.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.365+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:40:11.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.387+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:40:11.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:40:11.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.412+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:40:11.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.430+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:40:11.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.432+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:40:11.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.449+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:40:11.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.460+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:40:11.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.465+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:40:11.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.487+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:40:11.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.504+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:11.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.505+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:40:11.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.507+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:40:11.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.515+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:40:11.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.546+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:40:11.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.560+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:40:11.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.578+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:40:11.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.586+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:40:11.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.610+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:40:11.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.615+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:40:11.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.616+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:40:11.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.646+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:40:11.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.660+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:40:11.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:40:11.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.676+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:40:11.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.677+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:40:11.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.686+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:40:11.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.713+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:40:11.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.722+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:40:11.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.730+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:40:11.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.748+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:40:11.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 228 16 3094068 3094052 848.073 881.688 0.000757759 0.0011684 2024-09-17T16:40:11.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.755+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:40:11.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.758+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:40:11.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.792+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:40:11.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.792+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:40:11.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.805+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:40:11.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.807+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:40:11.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.841+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:40:11.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.866+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:40:11.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.877+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:40:11.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.893+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:40:11.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:40:11.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.897+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:40:11.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.906+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:40:11.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:40:11.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.939+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:40:11.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.946+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:40:11.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.961+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:40:11.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.969+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:40:11.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.976+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:40:11.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:11.994+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:40:12.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.001+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:40:12.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.013+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:40:12.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.026+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:40:12.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.026+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:40:12.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.030+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:40:12.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.038+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:40:12.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.058+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:40:12.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.069+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:40:12.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.087+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:40:12.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.117+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:40:12.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.142+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:40:12.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.144+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:40:12.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.149+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:40:12.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.180+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:40:12.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.185+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:40:12.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.202+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:40:12.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.204+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:40:12.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.207+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:40:12.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.212+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:40:12.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.231+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:40:12.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.236+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:40:12.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.239+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:40:12.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.246+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:40:12.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.256+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:40:12.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.259+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:40:12.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.273+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:40:12.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.314+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:40:12.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.334+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:40:12.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.334+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:40:12.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.344+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:40:12.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.354+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:40:12.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:40:12.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.393+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:40:12.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.397+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:40:12.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.402+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:40:12.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.431+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:40:12.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.446+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:40:12.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.464+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:40:12.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.465+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:40:12.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.472+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:40:12.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.491+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:40:12.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.494+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:40:12.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.525+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:40:12.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.530+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:40:12.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.539+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:40:12.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.540+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:40:12.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.556+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:40:12.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.577+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:40:12.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:40:12.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.596+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:40:12.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.607+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:40:12.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.612+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:40:12.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.622+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:40:12.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.633+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:40:12.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.638+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:40:12.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.641+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:40:12.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.653+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:40:12.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.662+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:12.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.666+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:40:12.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.677+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:40:12.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.694+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:40:12.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.718+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:40:12.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.719+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:12.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.725+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:40:12.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.746+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:40:12.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.750+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:40:12.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.754+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:40:12.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 229 16 3107647 3107631 848.076 848.688 0.000690537 0.00116836 2024-09-17T16:40:12.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.765+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:40:12.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.776+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:40:12.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.800+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:40:12.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.816+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:12.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.825+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:40:12.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.829+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:40:12.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.848+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:40:12.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.860+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:40:12.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.864+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:40:12.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:40:12.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.901+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:40:12.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.914+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:40:12.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.921+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:40:12.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.922+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:40:12.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.928+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:40:12.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.945+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:40:12.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:40:12.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.979+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:40:12.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.987+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:40:12.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:12.991+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:40:13.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.004+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:40:13.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.006+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:40:13.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.050+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:40:13.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.063+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:40:13.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.068+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:40:13.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.069+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:40:13.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.088+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:40:13.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.093+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:40:13.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.099+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:40:13.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.109+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:40:13.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.123+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:40:13.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.131+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:40:13.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.153+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:40:13.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.157+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:40:13.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.164+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:40:13.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:40:13.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.183+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:40:13.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.184+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:40:13.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.219+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:40:13.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.229+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:40:13.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.235+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:40:13.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.236+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:13.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.259+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:40:13.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.266+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:40:13.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.279+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:40:13.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.300+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:40:13.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.305+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:40:13.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.334+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:40:13.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.335+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:40:13.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.347+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:40:13.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.366+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:40:13.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.375+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:40:13.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.376+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:13.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:40:13.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.403+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:40:13.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.419+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:40:13.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.421+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:40:13.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.428+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:40:13.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.432+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:40:13.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.441+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:40:13.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.461+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:40:13.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.478+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:40:13.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.484+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:13.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.489+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:40:13.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.501+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:40:13.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.508+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:40:13.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.514+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:40:13.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.524+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:40:13.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.547+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:40:13.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.547+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:40:13.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.584+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:40:13.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.590+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:40:13.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.602+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:40:13.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.611+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:40:13.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.612+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:40:13.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.614+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:40:13.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.614+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:40:13.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:13.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.674+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:40:13.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.682+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:40:13.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.687+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:40:13.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.689+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:40:13.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.699+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:40:13.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.703+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:40:13.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.704+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:40:13.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.751+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:40:13.757 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 230 16 3121256 3121240 848.086 850.562 0.00388888 0.00116836 2024-09-17T16:40:13.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.759+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:40:13.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.776+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:40:13.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.790+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:40:13.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.793+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:40:13.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.799+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:40:13.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.805+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:40:13.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.838+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:40:13.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.848+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:40:13.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:40:13.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.857+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:13.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.864+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:40:13.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.869+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:40:13.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.880+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:40:13.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.885+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:40:13.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.896+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:40:13.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.919+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:40:13.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.928+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:40:13.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.941+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:40:13.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.948+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:40:13.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.960+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:40:13.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.969+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:40:13.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.974+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:40:14.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.996+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:40:14.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:13.997+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:40:14.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.000+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:40:14.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.008+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:40:14.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.023+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:40:14.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.025+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:40:14.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.060+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:40:14.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.064+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:40:14.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.079+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:40:14.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.086+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:40:14.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.088+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:40:14.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.096+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:40:14.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.104+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:40:14.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.110+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:40:14.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:14.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.144+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:40:14.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.149+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:40:14.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.154+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:40:14.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.177+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:40:14.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.202+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:40:14.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.236+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:40:14.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.237+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:40:14.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.243+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:40:14.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.259+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:40:14.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.264+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:40:14.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.274+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:40:14.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.282+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:40:14.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.301+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:40:14.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.305+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:40:14.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.329+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:40:14.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.331+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:40:14.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:40:14.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.352+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:40:14.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.366+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:40:14.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.390+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:40:14.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.408+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:40:14.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.450+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:40:14.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.457+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:40:14.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.461+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:40:14.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.462+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:40:14.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.467+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:40:14.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.492+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:40:14.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.496+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:40:14.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.506+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:40:14.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.509+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:40:14.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.534+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:40:14.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.552+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:40:14.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.572+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:40:14.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.573+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:40:14.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.577+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:40:14.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.591+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:40:14.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.599+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:40:14.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.626+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:40:14.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.643+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:14.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.656+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:40:14.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.657+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:40:14.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.679+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:40:14.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.690+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:40:14.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.708+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:40:14.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.714+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:40:14.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.737+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:40:14.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.742+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:40:14.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 231 16 3135300 3135284 848.214 877.75 0.000898282 0.0011682 2024-09-17T16:40:14.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.759+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:40:14.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.781+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:40:14.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.783+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:40:14.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.789+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:40:14.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.790+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:40:14.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.816+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:40:14.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.839+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:40:14.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.852+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:40:14.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.865+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:40:14.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.873+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:14.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.878+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:40:14.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.895+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:40:14.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.896+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:40:14.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.912+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:40:14.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.930+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:40:14.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.956+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:40:14.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.972+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:40:14.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.977+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:40:14.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.989+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:14.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:14.995+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:40:15.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.002+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:40:15.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.002+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:40:15.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.030+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:40:15.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.049+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:40:15.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.071+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:40:15.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.084+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:40:15.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.088+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:40:15.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.089+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:40:15.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.124+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:40:15.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.126+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:40:15.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.135+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:15.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.146+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:40:15.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.159+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:40:15.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.181+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:40:15.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.182+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:40:15.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.195+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:40:15.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.197+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:40:15.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.218+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:40:15.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.221+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:40:15.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.234+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:40:15.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.247+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:40:15.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.258+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:40:15.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:40:15.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.274+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:40:15.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.283+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:40:15.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.294+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:40:15.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.300+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:40:15.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.303+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:40:15.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.309+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:40:15.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.330+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:40:15.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.353+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:40:15.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.380+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:40:15.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.383+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:40:15.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.393+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:40:15.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.398+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:40:15.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.401+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:40:15.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.415+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:40:15.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.423+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:40:15.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.424+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:40:15.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.456+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:40:15.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.464+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:40:15.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.468+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:40:15.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.469+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:40:15.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.489+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:40:15.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.493+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:40:15.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.496+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:40:15.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.539+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:40:15.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.539+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:40:15.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.541+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:40:15.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.566+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:40:15.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.619+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:15.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.628+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:40:15.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.641+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:40:15.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.647+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:40:15.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.654+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:40:15.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.655+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:40:15.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.668+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:40:15.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.691+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:40:15.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.715+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:40:15.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.729+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:40:15.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.734+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:40:15.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.741+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:40:15.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 232 16 3148087 3148071 848.003 799.188 0.000646243 0.00116849 2024-09-17T16:40:15.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.759+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:40:15.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.761+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:15.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.772+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:40:15.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.776+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:40:15.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.785+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:40:15.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.808+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:40:15.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.828+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:40:15.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.830+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:40:15.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.834+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:40:15.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.855+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:40:15.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.857+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:40:15.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.858+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:40:15.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.863+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:15.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.878+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:40:15.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.886+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:40:15.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.889+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:40:15.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.907+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:40:15.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.914+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:15.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.925+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:40:15.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.946+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:40:15.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.965+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:40:15.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.968+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:40:15.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:15.973+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:40:16.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.003+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:16.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.016+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:40:16.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.019+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:40:16.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.023+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:40:16.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.023+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:40:16.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.048+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:40:16.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.057+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:40:16.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.070+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:40:16.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.074+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:40:16.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.086+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:40:16.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.088+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:40:16.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.105+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:40:16.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.112+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:40:16.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.121+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:40:16.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.135+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:16.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.161+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:16.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.162+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:40:16.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.183+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:40:16.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.191+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:40:16.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.201+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:40:16.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.207+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:40:16.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.228+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:40:16.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.228+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:40:16.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.238+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:40:16.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.253+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:40:16.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.267+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:40:16.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.272+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:40:16.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.287+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:40:16.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.294+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:40:16.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.303+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:40:16.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.308+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:40:16.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.310+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:40:16.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.314+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:40:16.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.345+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:40:16.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:40:16.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.365+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:40:16.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.401+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:16.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.405+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:40:16.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.410+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:40:16.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.431+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:40:16.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.454+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:40:16.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.457+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:40:16.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.460+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:40:16.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.475+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:40:16.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.492+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:40:16.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.501+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:40:16.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.502+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:40:16.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.508+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:40:16.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.519+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:40:16.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.540+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:16.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.545+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:40:16.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.559+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:40:16.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.581+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:40:16.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.582+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:40:16.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.595+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:40:16.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.599+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:40:16.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.602+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:40:16.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.610+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:40:16.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.616+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:40:16.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.616+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:40:16.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.665+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:40:16.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.667+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:40:16.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.682+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:40:16.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.693+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:40:16.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.693+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:40:16.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.693+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:40:16.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.720+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:40:16.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.725+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:40:16.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.727+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:40:16.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.741+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:40:16.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.749+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:40:16.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 233 16 3161361 3161345 847.923 829.625 0.000697741 0.00116858 2024-09-17T16:40:16.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.771+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:40:16.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.775+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:40:16.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.788+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:40:16.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.813+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:16.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.820+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:40:16.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.820+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:40:16.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.829+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:40:16.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.839+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:40:16.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.839+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:40:16.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.864+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:40:16.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.879+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:40:16.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.893+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:40:16.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.900+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:40:16.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.901+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:40:16.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.910+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:40:16.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.940+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:40:16.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.941+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:40:16.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.956+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:40:16.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.957+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:40:16.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:16.987+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:40:17.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.003+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:40:17.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.011+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:40:17.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.017+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:40:17.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.020+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:40:17.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.043+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:40:17.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.052+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:40:17.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.062+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:40:17.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.064+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:40:17.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.075+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:40:17.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.084+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:40:17.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.107+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:40:17.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.117+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:40:17.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.122+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:40:17.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.131+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:40:17.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.134+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:40:17.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.152+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:40:17.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.166+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:40:17.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.174+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:40:17.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.198+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:40:17.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.200+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:40:17.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.200+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:17.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.204+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:40:17.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.222+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:40:17.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.240+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:40:17.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.251+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:40:17.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.256+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:40:17.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.272+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:40:17.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.313+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:40:17.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.328+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:40:17.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.344+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:40:17.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.354+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:40:17.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.356+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:40:17.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.406+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:40:17.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.408+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:40:17.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.408+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:40:17.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.420+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:40:17.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.458+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:40:17.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.480+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:40:17.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.493+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:40:17.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.501+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:40:17.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.506+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:40:17.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.508+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:40:17.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.526+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:40:17.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.538+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:17.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.544+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:40:17.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.550+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:40:17.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.560+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:17.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.561+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:40:17.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:40:17.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.584+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:40:17.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.592+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:40:17.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.593+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:40:17.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.662+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:40:17.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.680+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:40:17.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.685+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:40:17.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.686+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:40:17.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.687+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:40:17.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.708+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:17.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.717+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:40:17.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.734+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:40:17.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.750+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:40:17.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 234 15 3174961 3174946 847.932 850.062 0.000562794 0.00116859 2024-09-17T16:40:17.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.763+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:40:17.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.788+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:40:17.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.794+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:40:17.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.824+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:40:17.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.827+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:40:17.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.836+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:40:17.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.850+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:40:17.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.862+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:40:17.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.863+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:40:17.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.892+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:40:17.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.903+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:40:17.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.908+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:40:17.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.908+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:40:17.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.937+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:40:17.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.940+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:40:17.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.942+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:40:17.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.961+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:40:17.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.972+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:40:17.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:17.978+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:40:18.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.021+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:40:18.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.031+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:40:18.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.040+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:40:18.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.048+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:40:18.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.066+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:40:18.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.074+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:40:18.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.077+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:40:18.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:40:18.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.090+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:40:18.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.095+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:40:18.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.122+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:40:18.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.130+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:40:18.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.141+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:40:18.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.148+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:40:18.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.168+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:18.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.174+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:40:18.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.178+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:40:18.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.179+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:40:18.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.188+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:40:18.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.205+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:40:18.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.209+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:40:18.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.216+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:40:18.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.232+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:40:18.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.247+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:40:18.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.257+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:40:18.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.291+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:40:18.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.302+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:40:18.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.316+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:40:18.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.318+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:40:18.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.355+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:40:18.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.361+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:40:18.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.368+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:18.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.371+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:40:18.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.375+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:40:18.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.411+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:40:18.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.429+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:40:18.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.447+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:40:18.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.458+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:40:18.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.474+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:40:18.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.488+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:40:18.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.500+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:40:18.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.516+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:40:18.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.526+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:40:18.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.530+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:40:18.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.533+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:40:18.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.536+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:40:18.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.551+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:40:18.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.559+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:40:18.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.575+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:40:18.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.581+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:40:18.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.585+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:40:18.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.586+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:40:18.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.599+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:40:18.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.633+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:40:18.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.640+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:40:18.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.646+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:40:18.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.651+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:40:18.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.653+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:40:18.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:40:18.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.705+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:40:18.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.725+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:40:18.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.734+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:40:18.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.753+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:18.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.753+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:40:18.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 235 16 3188887 3188871 848.027 870.312 0.000760885 0.00116846 2024-09-17T16:40:18.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.756+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:40:18.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.766+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:40:18.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.775+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:40:18.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.817+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:40:18.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.825+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:40:18.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.826+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:40:18.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.829+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:40:18.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.854+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:40:18.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.868+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:40:18.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.879+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:40:18.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.883+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:40:18.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.888+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:40:18.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.905+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:40:18.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.911+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:40:18.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.945+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:40:18.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.968+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:40:18.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.968+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:40:18.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:18.988+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:40:19.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.009+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:40:19.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.028+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:40:19.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.036+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:40:19.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.042+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:40:19.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.046+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:40:19.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.056+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:40:19.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.056+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:40:19.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.063+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:40:19.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.085+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:40:19.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.110+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:40:19.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.124+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:40:19.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.137+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:40:19.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.139+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:40:19.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.154+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:40:19.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.156+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:40:19.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.159+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:40:19.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.168+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:40:19.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.174+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:40:19.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.186+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:40:19.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.194+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:40:19.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.208+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:40:19.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.234+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:40:19.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.258+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:40:19.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.270+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:40:19.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.271+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:40:19.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.274+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:19.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.290+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:40:19.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.296+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:40:19.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.296+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:40:19.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.322+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:40:19.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.327+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:40:19.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.330+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:40:19.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.332+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:40:19.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.348+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:40:19.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.356+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:40:19.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.385+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:40:19.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.386+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:40:19.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.387+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:40:19.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.432+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:40:19.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.439+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:40:19.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.451+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:40:19.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.463+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:40:19.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.473+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:40:19.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.491+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:40:19.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.500+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:40:19.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.508+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:40:19.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.511+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:19.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.540+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:40:19.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.547+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:40:19.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.557+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:40:19.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.559+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:19.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.576+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:40:19.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.580+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:40:19.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.592+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f28dda7:::benchmark_data_smithi165_34272_object470:head, will try copies on 3,4 2024-09-17T16:40:19.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.623+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:40:19.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.637+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:40:19.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.640+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:40:19.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.658+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:40:19.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.669+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:40:19.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.676+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:40:19.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.687+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:40:19.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.700+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:40:19.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.717+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:40:19.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.726+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:40:19.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.727+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:40:19.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.738+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:40:19.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 236 16 3202746 3202730 848.104 866.188 0.00233351 0.00116835 2024-09-17T16:40:19.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.786+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:40:19.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.792+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:40:19.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.804+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:40:19.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.808+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:40:19.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.814+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:40:19.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.827+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:40:19.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.835+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:40:19.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.836+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:40:19.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.838+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:40:19.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.860+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:40:19.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.866+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:40:19.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.886+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:40:19.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.888+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:40:19.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.900+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:40:19.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.918+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:40:19.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.924+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:40:19.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.927+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:40:19.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.934+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:40:19.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.941+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:40:19.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.943+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:40:19.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.978+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:40:19.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:19.980+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:40:20.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.010+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:40:20.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.028+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:40:20.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.047+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:40:20.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.054+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:40:20.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.062+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:40:20.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.066+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:20.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.075+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:40:20.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.077+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:40:20.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.088+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:40:20.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.110+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:40:20.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.129+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:40:20.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.138+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:40:20.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.140+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:40:20.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.159+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:20.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.161+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:40:20.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.174+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:40:20.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.174+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:40:20.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.175+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:40:20.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.212+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:40:20.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.219+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:40:20.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.229+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:40:20.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.234+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:40:20.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.255+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:40:20.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.255+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:40:20.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.279+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:40:20.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.280+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:40:20.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.286+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:40:20.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.287+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:40:20.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.292+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:40:20.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.328+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:20.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.356+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:40:20.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.375+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:40:20.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.377+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:40:20.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.380+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:40:20.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.420+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:40:20.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.421+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:40:20.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.439+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:40:20.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.442+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:40:20.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.446+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:40:20.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.456+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:40:20.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.458+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:40:20.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.477+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:40:20.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.491+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:40:20.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.502+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:40:20.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.516+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:40:20.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.520+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:40:20.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.533+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:40:20.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.543+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:20.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.545+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:40:20.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.551+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:40:20.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:40:20.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.574+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:20.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.663+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:20.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.682+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:40:20.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.689+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:40:20.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.699+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:40:20.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:40:20.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.710+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:40:20.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.710+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:40:20.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.742+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:40:20.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.748+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:40:20.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 237 15 3215405 3215390 847.864 791.25 0.000762101 0.00116869 2024-09-17T16:40:20.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.756+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:40:20.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.762+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:40:20.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.788+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:40:20.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.797+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:40:20.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.798+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:40:20.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.802+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:40:20.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.819+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:40:20.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.822+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:40:20.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.829+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:40:20.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:40:20.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.864+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:40:20.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.865+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:40:20.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.869+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:40:20.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.872+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:40:20.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.903+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:40:20.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.907+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:40:20.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:20.914+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:40:21.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.024+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:40:21.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.047+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:40:21.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.048+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:40:21.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.073+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:40:21.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.077+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:40:21.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.088+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:40:21.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.115+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:40:21.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.120+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:40:21.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.126+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:40:21.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.133+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:40:21.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.160+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:40:21.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.166+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:40:21.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.170+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:40:21.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.191+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:40:21.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:40:21.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.201+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:40:21.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.216+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:40:21.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:40:21.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.267+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:40:21.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.269+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:40:21.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.279+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:21.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.283+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:21.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.294+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:40:21.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.306+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:40:21.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.309+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:40:21.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.327+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:40:21.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.341+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:40:21.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.353+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:40:21.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.367+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:40:21.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.367+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:40:21.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.379+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:40:21.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.408+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:40:21.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.414+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:40:21.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.414+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:40:21.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.420+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:40:21.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.433+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:40:21.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.440+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:40:21.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.449+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:40:21.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.489+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:40:21.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.509+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:40:21.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.520+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:40:21.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.524+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:40:21.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.551+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:40:21.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.552+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:40:21.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.554+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:40:21.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.569+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:40:21.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.573+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:40:21.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.580+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:40:21.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.599+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:40:21.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.602+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:40:21.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.630+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:40:21.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.632+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:40:21.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.637+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:40:21.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.637+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:40:21.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.659+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:40:21.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.668+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:40:21.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.675+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:40:21.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.688+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:40:21.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.698+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:40:21.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.703+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:40:21.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.713+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:40:21.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:40:21.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.721+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:40:21.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:40:21.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 238 16 3227815 3227799 847.56 775.562 0.00122375 0.0011691 2024-09-17T16:40:21.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.758+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:40:21.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.774+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:40:21.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.783+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:40:21.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.804+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:40:21.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.820+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:40:21.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.832+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:40:21.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.849+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:40:21.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.852+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:40:21.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.856+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:40:21.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.858+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:40:21.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.866+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:40:21.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.880+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:40:21.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.892+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:40:21.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.901+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:40:21.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.903+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:40:22.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:21.998+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:40:22.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.014+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:40:22.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.028+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:40:22.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.033+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:40:22.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.033+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:40:22.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.065+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:40:22.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.070+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:40:22.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.084+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:40:22.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.085+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:22.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.101+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:40:22.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.116+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:22.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.150+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:40:22.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:40:22.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.177+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:40:22.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.187+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:40:22.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.204+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:40:22.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.211+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:40:22.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.219+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:40:22.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.219+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:40:22.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:40:22.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.254+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:40:22.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.264+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:40:22.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.269+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:40:22.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.295+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:40:22.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.300+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:40:22.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.307+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:40:22.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.319+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:40:22.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.329+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:40:22.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.343+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:22.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.368+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:40:22.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.377+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:40:22.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.379+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:40:22.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.391+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:40:22.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.394+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:40:22.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.398+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:40:22.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.428+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:40:22.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.449+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:40:22.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.461+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:40:22.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.480+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:40:22.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.503+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:40:22.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.510+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:40:22.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.521+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:40:22.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.530+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:40:22.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.539+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:40:22.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.559+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:40:22.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.559+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:40:22.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.598+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:22.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.600+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:40:22.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.605+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:40:22.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.632+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:40:22.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.638+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:40:22.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:40:22.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.661+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:40:22.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.680+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:40:22.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.681+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:40:22.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.691+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:40:22.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.692+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:40:22.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.705+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:40:22.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.714+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:40:22.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.726+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:40:22.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 239 16 3240987 3240971 847.458 823.25 0.00145791 0.00116926 2024-09-17T16:40:22.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.760+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:40:22.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.784+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:22.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.792+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:40:22.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.814+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:40:22.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:40:22.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:40:22.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.838+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:40:22.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.839+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:22.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.852+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:40:22.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.881+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:40:22.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.896+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:22.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.909+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:40:22.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.915+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:40:22.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.934+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:40:22.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.938+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:40:22.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.954+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:40:22.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.970+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:40:22.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.973+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:40:22.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.980+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:40:22.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:22.982+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:40:23.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.006+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:40:23.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.006+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:40:23.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.030+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:40:23.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.040+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:40:23.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.059+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:40:23.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.065+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:40:23.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.067+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:40:23.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.076+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:40:23.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:40:23.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.108+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:40:23.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.111+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:40:23.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.142+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:40:23.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.150+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:40:23.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.164+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:40:23.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.173+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:40:23.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.181+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:40:23.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.191+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:40:23.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.192+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:40:23.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.219+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:40:23.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.238+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:40:23.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.244+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:40:23.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.248+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:40:23.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.250+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:40:23.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.272+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:40:23.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.274+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:40:23.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.304+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:40:23.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.312+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:40:23.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.315+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:40:23.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.328+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:40:23.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.342+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:40:23.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.350+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:40:23.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.351+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:40:23.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.357+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:40:23.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.372+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:40:23.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.402+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:40:23.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.407+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:40:23.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.411+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:40:23.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.419+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:40:23.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.425+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:40:23.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:40:23.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.459+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:40:23.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.506+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:40:23.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.516+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:40:23.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.526+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:40:23.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.533+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:40:23.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.539+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:40:23.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.553+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:40:23.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.554+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:40:23.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.566+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:40:23.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.569+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:40:23.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.579+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:40:23.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.598+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:40:23.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.599+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:40:23.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.605+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:40:23.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.635+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:40:23.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.639+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:40:23.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.642+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:40:23.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.648+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:40:23.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.664+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:40:23.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.679+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:40:23.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.680+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:40:23.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.696+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:40:23.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.712+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:40:23.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.718+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:40:23.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.721+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:40:23.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.725+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:23.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.744+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:40:23.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.751+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:40:23.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:40:23.757514+0000 min lat: 0.000227768 max lat: 0.222415 avg lat: 0.00116923 2024-09-17T16:40:23.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:40:23.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 240 16 3254560 3254544 847.461 848.312 0.000661178 0.00116923 2024-09-17T16:40:23.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.770+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:40:23.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.773+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:23.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.785+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:40:23.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.786+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:40:23.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.806+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:40:23.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.812+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:40:23.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:40:23.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.816+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:23.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.849+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:23.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.855+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:40:23.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.875+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:40:23.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.881+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:40:23.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.883+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:40:23.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.896+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:40:23.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.903+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:40:23.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.925+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:40:23.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.932+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:40:23.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.954+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:40:23.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.956+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:40:23.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.975+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:40:23.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.979+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:40:23.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:23.982+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:40:24.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.004+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:40:24.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.010+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:40:24.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.020+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:40:24.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.034+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:40:24.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.039+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:40:24.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.043+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:40:24.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.059+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:40:24.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.064+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:40:24.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.073+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:40:24.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.077+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:40:24.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.107+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:24.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.133+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:40:24.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.135+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:40:24.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.164+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:40:24.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.167+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:40:24.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.178+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:40:24.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.201+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:40:24.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.271+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:24.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.275+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:40:24.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.302+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:40:24.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.304+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:40:24.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.326+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:40:24.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.336+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:40:24.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.336+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:40:24.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.357+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:40:24.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.367+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:40:24.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.383+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:40:24.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.390+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:40:24.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.407+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:40:24.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.416+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:40:24.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.422+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:40:24.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.427+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:40:24.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.430+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:40:24.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.456+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:40:24.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.463+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:40:24.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.484+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:40:24.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.494+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:40:24.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.513+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:40:24.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.517+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:40:24.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:40:24.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.529+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:40:24.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.537+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:40:24.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.550+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:40:24.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.584+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:40:24.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.597+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:40:24.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.605+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:40:24.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.614+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:40:24.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.642+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:40:24.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.650+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:40:24.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.651+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:40:24.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.672+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:24.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.684+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:40:24.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.696+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:40:24.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.705+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:40:24.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.719+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:40:24.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.729+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:40:24.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.750+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:40:24.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.756+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:40:24.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 241 15 3267726 3267711 847.359 822.938 0.00108923 0.00116939 2024-09-17T16:40:24.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.786+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:40:24.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.796+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:40:24.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.805+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:40:24.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.806+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:40:24.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.837+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:40:24.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.855+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:40:24.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.869+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:40:24.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.869+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:24.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.871+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:40:24.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.881+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:40:24.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.899+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:40:24.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.929+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:40:24.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.932+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:40:24.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.949+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:40:24.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.959+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:40:24.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.980+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:40:24.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.980+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:40:25.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:24.998+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:40:25.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.001+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:40:25.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.014+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:40:25.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.021+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:40:25.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:40:25.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.044+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:40:25.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.055+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:40:25.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.057+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:40:25.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.061+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:25.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.089+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:40:25.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.091+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:40:25.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.099+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:40:25.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.110+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:40:25.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.129+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:40:25.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.129+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:40:25.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.140+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:40:25.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.172+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:40:25.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.177+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:40:25.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.182+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:40:25.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.196+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:40:25.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:40:25.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.222+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:40:25.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.243+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:40:25.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.259+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:40:25.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.278+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:40:25.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.282+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:40:25.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.289+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:40:25.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.301+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:40:25.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.306+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:40:25.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:40:25.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.329+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:25.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.334+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:40:25.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.341+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:40:25.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.361+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:40:25.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.361+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:40:25.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.377+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:40:25.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.390+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:40:25.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.398+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:40:25.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.426+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:40:25.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.429+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:40:25.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.456+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:40:25.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.461+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:40:25.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.465+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:40:25.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.487+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:40:25.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.493+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:40:25.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.502+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:40:25.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.511+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:40:25.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.542+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:40:25.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.548+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:40:25.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.562+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:40:25.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.567+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:40:25.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.569+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:40:25.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.602+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:40:25.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.624+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:40:25.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.636+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:40:25.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.655+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:40:25.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:40:25.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:40:25.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.726+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:40:25.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.741+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:40:25.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.750+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:40:25.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 242 16 3281221 3281205 847.342 843.375 0.000661296 0.00116941 2024-09-17T16:40:25.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.759+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:40:25.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.771+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:40:25.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.786+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:40:25.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.798+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:40:25.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.812+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:40:25.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.813+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:40:25.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.829+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:40:25.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.839+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:40:25.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.846+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:40:25.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.863+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:40:25.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.871+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:40:25.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.872+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:40:25.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.872+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:40:25.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.901+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:40:25.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.907+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:40:25.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.931+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:40:25.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.937+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:40:25.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.938+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:40:25.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:40:25.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.955+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:40:25.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.968+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:40:25.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:25.985+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:40:26.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.011+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:40:26.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.027+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:40:26.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.047+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:40:26.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:40:26.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.092+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:40:26.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.101+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:26.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.109+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:40:26.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:40:26.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.113+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:40:26.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.128+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:40:26.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.141+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:40:26.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.166+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:40:26.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:40:26.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.178+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:40:26.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.199+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:40:26.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.206+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:40:26.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.206+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:40:26.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.208+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:40:26.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.215+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:40:26.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.225+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:40:26.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.230+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:40:26.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.260+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:40:26.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.278+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:40:26.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.292+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:40:26.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.302+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:40:26.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.302+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:40:26.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.316+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:40:26.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.330+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:40:26.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.345+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:40:26.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.369+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:40:26.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.370+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:40:26.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.371+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:40:26.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.388+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:40:26.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.402+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:40:26.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.414+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:40:26.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.437+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:40:26.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.438+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:40:26.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.458+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:40:26.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.469+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:40:26.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.470+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:40:26.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.484+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:40:26.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.494+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:40:26.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.497+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:40:26.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.501+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:40:26.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.512+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:26.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.524+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:40:26.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.541+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:40:26.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.548+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:40:26.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.561+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:40:26.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.563+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:40:26.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.568+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:40:26.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.600+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:40:26.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.615+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:40:26.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.626+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:26.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.655+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:40:26.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.672+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:40:26.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.684+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:40:26.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.689+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:40:26.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.700+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:40:26.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.701+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:40:26.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.711+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:40:26.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.719+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:40:26.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.740+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:40:26.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.744+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:40:26.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 243 16 3294788 3294772 847.344 847.938 0.000689066 0.00116941 2024-09-17T16:40:26.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.759+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:40:26.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.767+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:40:26.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.789+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:40:26.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.792+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:40:26.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.798+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:40:26.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.807+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:26.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.815+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:40:26.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.818+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:40:26.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.835+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:40:26.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.844+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:40:26.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.867+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:40:26.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.871+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:40:26.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.876+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:40:26.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.876+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:40:26.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.886+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:40:26.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.887+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:40:26.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.911+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:40:26.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.924+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:40:26.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.932+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:40:26.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.949+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:40:26.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.964+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:40:26.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:26.991+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:40:27.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.000+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:40:27.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.001+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:40:27.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.015+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:40:27.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.035+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:40:27.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.055+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:40:27.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.069+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:40:27.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.070+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:40:27.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.085+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:40:27.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.115+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:40:27.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.129+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:40:27.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.134+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:40:27.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.138+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:40:27.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.144+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:40:27.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.162+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:40:27.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.164+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:40:27.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.178+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:40:27.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.201+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:40:27.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.211+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:40:27.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.220+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:40:27.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.230+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:40:27.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.250+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:40:27.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.258+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:40:27.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.272+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:40:27.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.274+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:40:27.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.282+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:40:27.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.283+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:40:27.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.288+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:40:27.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.293+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:40:27.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.331+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:40:27.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.343+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:40:27.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.352+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:40:27.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.363+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:40:27.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.370+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:40:27.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.375+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:40:27.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.395+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:40:27.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.399+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:40:27.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.417+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:27.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.430+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:40:27.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:27.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.438+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:40:27.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.440+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:40:27.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.443+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:40:27.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.462+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:40:27.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.471+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:40:27.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.514+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:40:27.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.558+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:40:27.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.564+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:40:27.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.566+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:40:27.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.588+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:40:27.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.596+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:40:27.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.598+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:40:27.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.616+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:40:27.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.637+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:40:27.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.642+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:40:27.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.653+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:27.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.671+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:40:27.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.676+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:40:27.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.689+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:40:27.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.694+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:40:27.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.704+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:40:27.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.715+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:40:27.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.722+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:40:27.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.738+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:40:27.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.749+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:40:27.758 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 244 15 3308260 3308245 847.322 842.062 0.000464507 0.00116944 2024-09-17T16:40:27.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.757+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:40:27.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.763+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:40:27.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.766+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:27.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.772+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:40:27.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.810+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:40:27.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.815+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:40:27.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.839+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:40:27.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.854+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:40:27.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.867+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:40:27.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.871+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:40:27.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.875+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:40:27.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.883+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:40:27.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.887+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:40:27.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.912+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:40:27.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.916+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:40:27.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.934+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:40:27.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.944+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:40:27.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.944+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:40:27.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.951+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:40:27.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.958+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:40:28.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:27.997+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:40:28.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.008+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:40:28.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.011+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:40:28.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.025+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:40:28.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.032+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:40:28.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.036+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:40:28.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.047+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:28.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.057+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:40:28.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.064+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:40:28.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.077+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:40:28.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.078+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:40:28.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.107+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:40:28.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.115+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:28.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.116+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:40:28.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.128+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:28.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.138+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:40:28.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.147+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:40:28.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.155+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:40:28.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.168+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:40:28.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.193+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:40:28.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.200+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:40:28.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.201+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:40:28.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.203+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:40:28.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.233+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:40:28.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.245+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:40:28.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.262+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:40:28.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.278+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:40:28.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.290+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:40:28.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.322+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:40:28.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.324+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:40:28.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.330+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:40:28.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.348+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:40:28.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.383+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:40:28.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.385+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:40:28.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.389+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:40:28.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.391+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:40:28.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.424+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:40:28.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.458+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:40:28.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.490+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:40:28.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.491+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:40:28.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.506+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:40:28.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.512+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:40:28.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.532+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:40:28.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.561+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:40:28.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.562+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:40:28.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.575+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:40:28.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.582+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:40:28.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.605+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:40:28.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.624+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:40:28.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.628+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:40:28.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.639+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:40:28.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.647+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:40:28.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.672+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:40:28.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.675+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:40:28.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.679+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:40:28.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.692+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:40:28.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.720+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:40:28.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.735+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:40:28.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.750+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:40:28.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 245 16 3322145 3322129 847.405 867.75 0.000657144 0.00116933 2024-09-17T16:40:28.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.772+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:40:28.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.788+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:40:28.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.789+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:40:28.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.790+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:40:28.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.816+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:40:28.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.818+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:40:28.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.839+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:40:28.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.847+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:40:28.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.848+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:40:28.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.855+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:40:28.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.868+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:40:28.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.879+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:40:28.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.884+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:40:28.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.918+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:40:28.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.941+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:40:28.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.952+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:28.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.955+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:40:28.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.961+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:40:28.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.973+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:40:28.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.988+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:40:28.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:28.995+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:40:29.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.029+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:40:29.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.037+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:40:29.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.047+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:40:29.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.047+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:40:29.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.050+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:40:29.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.086+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:40:29.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.087+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:40:29.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.094+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:40:29.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.110+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:40:29.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.119+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:40:29.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.143+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:40:29.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.150+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:29.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.154+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:40:29.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.157+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:40:29.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.165+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:40:29.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.220+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:40:29.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.226+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:40:29.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:40:29.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.236+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:40:29.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.257+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:40:29.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.264+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:40:29.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.266+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:40:29.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.289+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:40:29.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.292+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:40:29.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.304+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:40:29.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.316+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:40:29.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.327+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:40:29.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.329+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:40:29.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.338+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:40:29.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:40:29.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.356+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:40:29.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:40:29.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.386+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:40:29.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.388+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:40:29.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.405+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:40:29.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.420+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:40:29.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.420+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:40:29.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.458+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:40:29.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.473+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:40:29.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.473+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:40:29.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.489+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:40:29.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.490+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:40:29.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.498+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:40:29.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.509+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:40:29.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.520+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:40:29.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.552+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:40:29.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.568+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:40:29.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:40:29.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.616+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:40:29.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.622+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:40:29.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.631+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:40:29.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.636+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:40:29.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.657+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:40:29.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.657+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:40:29.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:40:29.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.693+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:40:29.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.715+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:29.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.723+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:40:29.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.727+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:40:29.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.737+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:29.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.747+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:40:29.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.751+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:40:29.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 246 16 3336103 3336087 847.506 872.375 0.000691294 0.00116918 2024-09-17T16:40:29.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.764+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:40:29.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.781+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc0572b7:::benchmark_data_smithi165_34272_object1846:head, will try copies on 2,3 2024-09-17T16:40:29.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.802+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:40:29.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.803+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:40:29.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.827+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:40:29.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.840+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:40:29.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.845+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:40:29.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.846+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:40:29.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.876+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:40:29.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.879+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:40:29.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.881+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:40:29.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.911+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:29.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.920+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:40:29.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.925+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:40:29.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.928+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:40:29.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.944+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:40:29.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.952+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:40:29.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.952+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:40:29.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.995+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:40:29.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:29.997+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:40:30.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:40:30.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.014+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:40:30.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.019+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:30.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.059+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:40:30.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.076+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:40:30.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.077+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:30.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.098+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:40:30.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.102+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:40:30.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:40:30.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.131+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:40:30.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.143+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:40:30.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.145+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:40:30.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.164+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:40:30.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.174+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:40:30.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.178+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:40:30.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.194+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:40:30.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:40:30.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.199+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:40:30.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.208+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:40:30.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.221+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:40:30.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.229+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:40:30.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.238+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:40:30.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.253+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:40:30.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.265+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:40:30.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.280+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:40:30.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.291+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:40:30.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.299+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:40:30.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.316+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:40:30.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.320+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:30.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.349+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:40:30.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.357+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:40:30.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.379+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:40:30.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.382+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:40:30.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.404+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:40:30.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.414+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:40:30.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.426+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:40:30.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:40:30.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.455+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:40:30.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.467+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:30.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.480+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:40:30.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.481+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:40:30.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.495+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:40:30.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.518+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:40:30.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:40:30.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.561+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:40:30.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.562+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:40:30.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.565+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:40:30.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.574+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:30.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.582+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:40:30.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.593+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:40:30.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.613+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:40:30.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.617+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:40:30.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.624+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:40:30.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.651+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:40:30.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.659+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:40:30.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.664+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:40:30.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.682+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:40:30.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.703+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:30.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.711+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:30.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.747+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:40:30.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.756+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:40:30.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 247 16 3349798 3349782 847.54 855.938 0.000734494 0.00116912 2024-09-17T16:40:30.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.779+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:40:30.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.789+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:40:30.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.797+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:40:30.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.803+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:40:30.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.818+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:40:30.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.838+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:40:30.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.854+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:40:30.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.861+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:40:30.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.865+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:40:30.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.870+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:40:30.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.909+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:40:30.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.918+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:40:30.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.936+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:40:30.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.942+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:40:30.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.965+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:40:30.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.974+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:30.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.980+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:40:30.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.981+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:40:31.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:30.998+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:40:31.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.002+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:31.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.008+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:40:31.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.011+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:40:31.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.024+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:40:31.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.055+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:40:31.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.074+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:40:31.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.075+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:40:31.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.083+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:40:31.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.089+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:40:31.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:40:31.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.104+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:40:31.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.110+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:40:31.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.122+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:40:31.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.156+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:40:31.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.164+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:40:31.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.166+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:40:31.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.179+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:40:31.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.183+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:40:31.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.188+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:40:31.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.212+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:40:31.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.223+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:40:31.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.239+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:40:31.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.248+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:40:31.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.252+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:40:31.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.264+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:40:31.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.271+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:40:31.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.282+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:40:31.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.298+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:40:31.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.306+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:40:31.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.307+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:40:31.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:40:31.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.352+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:40:31.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.352+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:40:31.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.355+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:40:31.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.360+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:40:31.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.371+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:40:31.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.379+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:40:31.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.380+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:40:31.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.405+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:40:31.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.415+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:40:31.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.419+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:40:31.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.431+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:40:31.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.448+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:40:31.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.467+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:40:31.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.472+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:40:31.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.481+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:40:31.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.481+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:40:31.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.496+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:40:31.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.526+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:31.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.527+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:40:31.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:40:31.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.553+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:40:31.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.560+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:40:31.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.563+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:40:31.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.590+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:40:31.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.597+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:40:31.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.606+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:40:31.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:40:31.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.614+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:40:31.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.636+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:40:31.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.639+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:40:31.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.654+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:31.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.664+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:40:31.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.675+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:40:31.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.686+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:40:31.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.690+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:40:31.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.699+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:40:31.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.711+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:40:31.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.737+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:40:31.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 248 15 3363165 3363150 847.491 835.5 0.000797252 0.00116921 2024-09-17T16:40:31.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.764+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:40:31.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.766+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:40:31.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.788+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:40:31.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.789+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:40:31.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.802+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:40:31.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.808+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:40:31.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.854+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:40:31.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.865+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:40:31.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.866+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:40:31.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.887+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:40:31.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.908+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:40:31.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.918+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:40:31.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.940+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:40:31.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.946+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:40:31.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.956+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:40:31.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.980+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:40:31.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.997+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:31.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:31.997+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:40:32.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.008+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:40:32.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.011+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:40:32.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.027+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:40:32.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.044+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:40:32.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.048+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:40:32.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.074+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:40:32.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.074+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:40:32.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.092+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:40:32.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.110+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:40:32.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.136+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:40:32.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.138+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:32.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.139+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:40:32.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.150+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:40:32.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.163+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:40:32.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.176+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:40:32.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.188+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:40:32.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.193+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:40:32.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.193+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:40:32.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.200+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:40:32.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.202+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:40:32.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.218+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:40:32.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.232+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:40:32.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.265+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:40:32.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.268+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:40:32.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.269+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:40:32.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.276+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:40:32.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.289+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:40:32.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.302+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:40:32.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.321+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:40:32.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.323+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:40:32.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.329+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:40:32.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.343+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:40:32.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.352+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:40:32.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.356+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:40:32.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.369+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:40:32.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.389+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:32.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.396+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:40:32.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.406+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:40:32.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.429+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:40:32.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.442+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:40:32.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.454+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:40:32.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.456+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:40:32.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.456+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:40:32.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.476+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:40:32.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.494+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:40:32.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.496+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:40:32.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.522+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:40:32.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.528+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:40:32.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.530+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:40:32.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.548+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:40:32.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.550+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:40:32.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.569+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:40:32.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.574+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:40:32.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.586+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:40:32.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.613+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:40:32.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.617+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:40:32.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.636+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:40:32.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.641+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:40:32.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.657+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:40:32.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.665+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:40:32.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.670+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:40:32.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.687+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:40:32.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.692+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:32.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.694+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:40:32.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.696+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:40:32.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.715+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:40:32.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.720+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:32.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.750+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:40:32.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.755+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:40:32.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 249 16 3377029 3377013 847.567 866.438 0.00071807 0.0011691 2024-09-17T16:40:32.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.774+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:32.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.797+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:40:32.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:40:32.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:40:32.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.812+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:40:32.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.836+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:40:32.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.852+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:40:32.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.871+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:40:32.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.903+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:40:32.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.908+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:40:32.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.919+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:40:32.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.931+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:40:32.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.951+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:40:32.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.952+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:40:32.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.970+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:40:32.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.970+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:40:32.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.989+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:40:32.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:32.994+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:40:33.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.000+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:40:33.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.009+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:40:33.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.015+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:40:33.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.019+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:40:33.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.020+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:40:33.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.044+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:40:33.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.063+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:40:33.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.070+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:40:33.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.077+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:40:33.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.092+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:40:33.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.097+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:40:33.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:40:33.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.121+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:40:33.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.142+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:40:33.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.151+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:40:33.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.166+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:40:33.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.179+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:40:33.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.191+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:40:33.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.195+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:40:33.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.207+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:40:33.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.223+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:33.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.223+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:40:33.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.242+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:40:33.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.264+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:40:33.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.268+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:40:33.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.292+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:40:33.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:40:33.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.328+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:40:33.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.346+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:40:33.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.353+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:40:33.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.361+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:40:33.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.375+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:40:33.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.404+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:40:33.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.413+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:40:33.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.424+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:33.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.437+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:40:33.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.443+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:40:33.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.445+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:40:33.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.447+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:40:33.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.452+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:40:33.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.461+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:40:33.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.486+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:40:33.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.513+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:40:33.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.514+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:40:33.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.531+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:40:33.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.536+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:40:33.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.538+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:40:33.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.547+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:40:33.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.552+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:40:33.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.566+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:40:33.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.567+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:40:33.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.581+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:40:33.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.612+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:40:33.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.622+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:40:33.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.626+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:40:33.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.627+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:40:33.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.637+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:40:33.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.645+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:40:33.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.658+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:40:33.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.675+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:40:33.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.681+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:40:33.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.712+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:40:33.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.721+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:40:33.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.723+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:40:33.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.731+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:40:33.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.743+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:40:33.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 250 15 3390798 3390783 847.619 860.625 0.00131488 0.00116902 2024-09-17T16:40:33.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.762+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:40:33.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.776+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:33.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.785+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:40:33.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.788+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:40:33.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.789+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:33.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.797+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:40:33.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.830+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:40:33.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.831+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:40:33.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.841+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:40:33.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.848+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:40:33.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.852+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:40:33.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.860+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:33.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.863+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:40:33.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.889+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:40:33.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.896+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:40:33.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.899+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:40:33.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.903+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:40:33.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.944+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:40:33.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.970+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:40:33.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.972+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:40:33.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.976+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:40:33.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:33.995+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:40:34.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.006+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:40:34.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.007+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:40:34.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.020+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:34.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.022+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:40:34.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:40:34.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.063+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:40:34.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.080+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:40:34.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.091+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:40:34.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.102+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:40:34.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.121+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:40:34.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.131+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:40:34.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.131+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:40:34.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.137+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:40:34.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.143+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:40:34.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.149+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:40:34.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.149+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:40:34.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.168+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:40:34.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.212+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:40:34.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.215+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:40:34.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.233+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:40:34.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.236+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:40:34.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.246+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:34.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.249+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:40:34.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.255+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:40:34.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.261+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:40:34.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.269+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:40:34.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:40:34.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.299+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:40:34.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.301+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:40:34.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.331+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:40:34.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.335+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:40:34.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.338+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:40:34.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:40:34.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.374+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:40:34.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.375+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:40:34.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.376+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:40:34.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.379+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:40:34.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.420+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:40:34.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.421+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:40:34.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.440+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:40:34.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.450+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:40:34.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.455+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:40:34.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.456+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:40:34.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.462+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:40:34.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.492+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:40:34.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.511+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:40:34.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.513+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:40:34.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:40:34.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.527+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:40:34.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.543+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:40:34.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.563+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:40:34.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.575+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:40:34.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.579+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:40:34.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.593+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:40:34.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.597+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:40:34.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.608+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:40:34.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:34.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.617+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:40:34.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.620+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:34.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.635+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:40:34.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.641+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:40:34.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.642+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:40:34.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.664+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:40:34.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.676+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:40:34.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.682+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:40:34.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.694+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:40:34.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.694+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:40:34.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.725+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:40:34.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.728+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:40:34.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.730+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:40:34.759 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 251 16 3404057 3404041 847.543 828.625 0.000740839 0.00116914 2024-09-17T16:40:34.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.763+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:40:34.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.767+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:40:34.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.773+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:40:34.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.784+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:40:34.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.805+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:40:34.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.819+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:40:34.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:40:34.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.824+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:40:34.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.838+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:40:34.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.852+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:40:34.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.869+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:40:34.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.878+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:40:34.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.880+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:40:34.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.894+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:40:34.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.922+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:40:34.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.928+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:40:34.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.929+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:40:34.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.943+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:40:34.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.969+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:40:34.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.974+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:40:34.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.978+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:40:34.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:40:34.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.987+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:40:34.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:34.995+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:40:35.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.015+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:40:35.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.016+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:40:35.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.038+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:40:35.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.048+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:40:35.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.066+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:35.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.069+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:40:35.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.075+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:40:35.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.094+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:40:35.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.106+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:40:35.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:40:35.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.136+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:40:35.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.139+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:40:35.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.140+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:35.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.164+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:40:35.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.175+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:40:35.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.180+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:40:35.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.181+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:40:35.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.185+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:40:35.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.193+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:40:35.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.199+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:35.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.209+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:40:35.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.212+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:40:35.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.245+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:40:35.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.252+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:40:35.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.273+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:40:35.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.276+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:40:35.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.293+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:40:35.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.302+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:40:35.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.314+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:40:35.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.317+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:40:35.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.323+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:40:35.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.326+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:40:35.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:40:35.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.355+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:40:35.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.365+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:40:35.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.373+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:40:35.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.390+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:40:35.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.397+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:40:35.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.406+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:40:35.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.417+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:40:35.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.423+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:40:35.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:40:35.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.446+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:40:35.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.457+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:40:35.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.464+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:40:35.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.481+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:40:35.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.497+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:40:35.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.538+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:40:35.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.544+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:40:35.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.555+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:40:35.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.565+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:40:35.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.571+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:40:35.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.572+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:40:35.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.601+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:40:35.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.606+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:40:35.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.609+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:40:35.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.618+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:40:35.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.628+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:40:35.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.638+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:40:35.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.661+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:40:35.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.664+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:40:35.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.669+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:40:35.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.696+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:40:35.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.699+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:40:35.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.702+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:35.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.711+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:40:35.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.720+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:40:35.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.722+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:40:35.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.728+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:40:35.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 252 15 3417608 3417593 847.54 847 0.000682166 0.00116912 2024-09-17T16:40:35.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.764+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:40:35.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.776+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:40:35.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.792+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:40:35.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.801+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:40:35.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.807+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:40:35.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.826+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:40:35.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.842+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:40:35.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.858+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:40:35.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.869+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:40:35.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.871+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:40:35.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.884+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:40:35.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.892+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:40:35.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.898+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:40:35.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.904+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:40:35.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.915+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:40:35.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.919+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:40:35.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.958+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:40:35.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.961+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:40:35.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.974+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:40:35.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:35.995+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:40:36.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.005+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:40:36.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.007+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:40:36.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.010+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:40:36.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.026+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:40:36.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.028+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:40:36.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.037+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:40:36.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.044+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:40:36.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.073+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:40:36.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.073+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:40:36.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.079+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:40:36.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.097+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:40:36.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.117+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:40:36.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.127+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:40:36.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.155+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:40:36.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.164+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:40:36.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.170+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:40:36.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.183+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:40:36.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.187+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:40:36.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.219+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:40:36.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.220+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:40:36.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.226+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:40:36.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.249+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:40:36.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.251+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:40:36.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.255+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:40:36.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.268+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:40:36.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.278+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:40:36.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.298+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:40:36.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.313+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:40:36.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.315+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:40:36.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.341+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:40:36.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.347+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:40:36.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.349+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:40:36.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.370+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:40:36.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.385+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:40:36.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.389+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:40:36.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.390+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:36.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.410+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:40:36.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.416+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:40:36.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.439+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:40:36.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.453+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:40:36.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.454+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:40:36.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.459+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:40:36.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.491+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:40:36.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.528+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:40:36.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.531+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:40:36.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.549+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:40:36.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.560+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:40:36.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.570+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:40:36.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.574+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:36.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.589+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:40:36.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.590+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:40:36.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.608+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:40:36.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.614+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:40:36.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:40:36.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.625+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:40:36.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.635+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:40:36.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.646+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:40:36.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.647+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:40:36.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.668+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:40:36.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.698+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:40:36.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.710+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:40:36.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.722+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:40:36.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.730+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:40:36.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.739+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:40:36.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 253 16 3431639 3431623 847.656 876.875 0.000525897 0.00116898 2024-09-17T16:40:36.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.759+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:40:36.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.768+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:40:36.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.769+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:40:36.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.776+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:36.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.779+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:40:36.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.792+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:40:36.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.802+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:40:36.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.807+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:40:36.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.809+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:40:36.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.809+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:40:36.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.827+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:40:36.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.846+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:40:36.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:40:36.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.861+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:40:36.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.881+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:40:36.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.883+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:40:36.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.883+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:36.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.889+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:40:36.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.932+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:40:36.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:36.943+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:40:37.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.008+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:40:37.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.022+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:40:37.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.046+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:40:37.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.059+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:40:37.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.063+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:40:37.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:40:37.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.091+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:40:37.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.091+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:40:37.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.094+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:40:37.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.117+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:40:37.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.132+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:40:37.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.142+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:37.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.148+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:40:37.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.149+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:40:37.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.176+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:40:37.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.185+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:40:37.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.193+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:40:37.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.195+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:40:37.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.211+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:40:37.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.218+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:40:37.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.219+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:40:37.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.224+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:40:37.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.238+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:40:37.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.253+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:40:37.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.256+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:40:37.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.267+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:40:37.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.283+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:40:37.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.284+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:40:37.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.311+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:40:37.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.326+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:40:37.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.326+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:40:37.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.332+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:40:37.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.352+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:40:37.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.362+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:40:37.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.390+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:40:37.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.409+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:40:37.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.410+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:40:37.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.410+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:40:37.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.426+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:40:37.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.426+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:40:37.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.446+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:37.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.447+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:40:37.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.459+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:40:37.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.470+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:40:37.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:40:37.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.492+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:40:37.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.514+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:40:37.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.514+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:40:37.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.534+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:40:37.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.595+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:40:37.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.613+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:40:37.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.629+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:37.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.629+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:40:37.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.632+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:40:37.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.634+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:40:37.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.643+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:40:37.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.645+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:40:37.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:40:37.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.682+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:40:37.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.718+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:40:37.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.720+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:40:37.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.749+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:37.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.751+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:40:37.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 254 16 3444617 3444601 847.511 811.125 0.000687807 0.00116918 2024-09-17T16:40:37.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.767+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:40:37.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.800+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:40:37.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.805+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:40:37.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.808+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:40:37.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.815+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:40:37.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.830+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:40:37.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.842+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:40:37.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.861+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:40:37.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.868+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:40:37.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.868+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:40:37.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.887+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:40:37.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.889+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:40:37.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.899+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:40:37.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.930+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:40:37.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.942+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:40:37.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.952+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:37.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.957+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:40:37.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.970+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:40:37.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.975+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:37.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.990+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:40:37.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:37.997+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:40:38.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.015+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:40:38.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.020+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:40:38.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.023+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:40:38.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.027+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:40:38.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.029+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:40:38.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.035+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:40:38.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.059+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:40:38.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.076+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:40:38.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.100+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:40:38.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.114+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:40:38.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.134+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:40:38.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.143+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:40:38.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.143+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:40:38.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.162+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:40:38.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.187+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:40:38.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.190+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:40:38.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.202+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:40:38.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.203+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:40:38.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.216+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:40:38.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.229+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:40:38.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.259+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:40:38.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.271+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:40:38.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.285+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:40:38.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.297+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:40:38.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.306+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:40:38.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.309+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:40:38.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.313+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:40:38.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.335+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:40:38.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.335+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:38.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.341+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:40:38.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.361+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:40:38.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.365+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:40:38.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.388+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:40:38.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.397+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:40:38.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.400+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:40:38.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.406+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:40:38.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.408+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:40:38.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.439+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:40:38.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.452+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:40:38.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.461+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:40:38.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.486+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:40:38.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.488+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:40:38.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.505+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:38.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.513+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:40:38.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.519+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:40:38.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.521+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:40:38.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.559+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:40:38.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.564+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:40:38.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.581+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:40:38.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.581+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:40:38.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.599+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:40:38.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.606+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:40:38.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.608+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:40:38.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:40:38.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.643+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:40:38.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.646+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:40:38.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.650+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:40:38.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.657+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:40:38.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.671+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:40:38.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.686+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:40:38.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.686+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:40:38.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.695+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:38.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:40:38.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.709+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:40:38.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.732+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:40:38.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.753+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:40:38.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.757+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:40:38.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 255 16 3457809 3457793 847.421 824.5 0.000471845 0.0011693 2024-09-17T16:40:38.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.762+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:38.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.783+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:40:38.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.801+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:40:38.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.817+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:40:38.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:40:38.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.828+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:40:38.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.841+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:40:38.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.843+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:40:38.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.866+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:40:38.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.870+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:40:38.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.876+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:40:38.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.885+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:40:38.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.894+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:40:38.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.897+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:40:38.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.906+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:40:38.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.914+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:40:38.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.921+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:40:38.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.951+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:40:38.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.952+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:40:38.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.966+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:40:38.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.974+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:40:38.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:38.986+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:40:39.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.008+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:40:39.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.014+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:40:39.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.028+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:40:39.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.036+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:40:39.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.038+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:40:39.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.047+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:40:39.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.060+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:40:39.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.073+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:40:39.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.084+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:40:39.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.091+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:40:39.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.094+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:40:39.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.130+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:40:39.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.134+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:40:39.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.142+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:40:39.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:40:39.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.180+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:40:39.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.181+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:40:39.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.197+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:39.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.234+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:40:39.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.245+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:40:39.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.249+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:40:39.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.264+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:40:39.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.270+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:40:39.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.287+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:40:39.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.288+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:40:39.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.313+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:40:39.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.318+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:40:39.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.320+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:40:39.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.349+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:40:39.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.356+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:40:39.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.358+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:40:39.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.387+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:40:39.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.407+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:40:39.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.418+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:40:39.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.438+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:40:39.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:40:39.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.450+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:40:39.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.478+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:40:39.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.481+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:40:39.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.493+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:40:39.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.502+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:40:39.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.504+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:40:39.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.505+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:40:39.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.513+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:40:39.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:40:39.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.548+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:40:39.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.556+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:40:39.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.558+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:40:39.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.573+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:40:39.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.577+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:40:39.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.609+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:40:39.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.612+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:40:39.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.615+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:40:39.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.624+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:40:39.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.629+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:40:39.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.636+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:40:39.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.651+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:40:39.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.651+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:40:39.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.658+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:40:39.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.667+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:40:39.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.682+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:40:39.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.696+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:40:39.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.698+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:40:39.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.713+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:40:39.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.728+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:40:39.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.749+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:40:39.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.751+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:40:39.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.751+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:40:39.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 256 16 3471073 3471057 847.349 829 0.00111593 0.0011694 2024-09-17T16:40:39.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.759+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:39.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.765+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:40:39.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.766+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:40:39.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.806+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:40:39.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.806+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:39.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.812+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:40:39.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.822+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:40:39.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.831+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:40:39.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.839+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:40:39.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.851+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:40:39.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.878+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:40:39.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.881+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:40:39.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.899+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:40:39.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.914+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:39.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.915+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:40:39.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.918+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:40:39.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.938+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:40:39.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.954+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:40:39.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.963+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:40:39.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.965+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:40:39.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.979+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:40:39.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.990+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:40:39.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:39.994+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:40:40.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.000+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:40:40.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.003+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:40:40.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.005+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:40:40.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.041+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:40:40.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:40:40.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.059+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:40:40.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.062+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:40:40.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.070+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:40.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.075+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:40:40.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.084+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:40.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.106+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:40:40.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.130+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:40:40.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.135+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:40:40.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.149+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:40:40.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.161+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:40:40.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.169+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:40:40.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.172+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:40:40.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.179+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:40:40.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.185+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:40:40.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.188+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:40:40.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.215+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:40:40.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:40:40.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.266+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:40:40.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.281+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:40:40.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.303+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:40:40.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.305+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:40:40.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.316+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:40:40.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.342+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:40:40.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.364+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:40:40.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.365+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:40:40.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.407+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:40:40.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.425+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:40:40.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.431+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:40:40.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.444+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:40:40.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.451+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:40:40.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.455+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:40:40.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.459+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:40:40.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.465+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:40:40.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.467+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:40:40.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.496+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:40:40.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.515+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:40:40.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.519+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:40:40.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.541+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:40:40.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.550+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:40:40.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.575+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:40:40.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.578+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:40:40.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.582+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:40:40.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.584+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:40:40.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.592+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:40:40.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.614+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:40.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.617+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:40:40.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.668+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:40:40.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.673+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:40:40.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.683+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:40:40.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.685+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:40:40.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.744+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:40:40.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 257 16 3484113 3484097 847.223 815 0.000669192 0.00116958 2024-09-17T16:40:40.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.762+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:40:40.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.765+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:40:40.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.778+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:40:40.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.783+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:40.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.800+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:40:40.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.808+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:40:40.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.812+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:40:40.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.822+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:40:40.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.824+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:40:40.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.844+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:40:40.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.855+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:40:40.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.874+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:40:40.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:40:40.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.883+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:40:40.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.903+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:40.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.905+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:40:40.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.905+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:40.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.919+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:40:40.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.932+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:40:40.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.940+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:40:40.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:40.954+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:40:41.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.001+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:41.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.001+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:40:41.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.022+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:40:41.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.022+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:40:41.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.046+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:40:41.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.054+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:40:41.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.055+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:40:41.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.065+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:40:41.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.074+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:40:41.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.084+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:40:41.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.091+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:40:41.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.099+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:40:41.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.119+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:40:41.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.123+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:40:41.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.138+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:40:41.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.154+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:40:41.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.178+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:40:41.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.179+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:40:41.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.181+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:40:41.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.197+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:40:41.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.209+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:40:41.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.212+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:40:41.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.235+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:41.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.244+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:40:41.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.259+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:40:41.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.275+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:40:41.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.277+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:40:41.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.283+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:41.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.314+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:40:41.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.316+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:40:41.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.340+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:40:41.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.344+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:40:41.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.346+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:41.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.348+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:40:41.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.355+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:40:41.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.366+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:40:41.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.383+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:40:41.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.405+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:40:41.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.419+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:40:41.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:40:41.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.436+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:40:41.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.442+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:40:41.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.443+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:40:41.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.477+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:40:41.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.484+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:40:41.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.485+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:40:41.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.507+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:40:41.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.532+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:40:41.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.544+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:40:41.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.545+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:40:41.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.550+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:40:41.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.574+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:40:41.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.579+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:40:41.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.585+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:40:41.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.591+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:40:41.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.600+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:40:41.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.620+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:40:41.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.639+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:40:41.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.641+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:40:41.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.653+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:40:41.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:40:41.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.689+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:40:41.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.695+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:40:41.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.697+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:40:41.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.716+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:40:41.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.722+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:41.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.752+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:40:41.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.756+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:40:41.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 258 16 3497633 3497617 847.214 845 0.000644722 0.0011696 2024-09-17T16:40:41.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.761+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:41.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.762+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:40:41.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.801+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:40:41.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.820+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:40:41.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.826+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:40:41.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.844+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:40:41.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.850+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:40:41.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.868+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:40:41.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.872+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:40:41.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.891+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:40:41.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.901+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:40:41.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.908+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:40:41.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.931+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:40:41.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.938+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:40:41.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.947+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:40:41.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.949+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:40:41.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.958+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:40:41.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.959+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:40:41.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.970+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:40:41.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.980+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:40:42.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:41.998+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:40:42.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.000+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:40:42.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.005+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:40:42.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.028+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:40:42.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.032+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:40:42.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.036+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:40:42.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.085+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:40:42.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:40:42.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.098+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:40:42.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.100+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:40:42.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.134+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:40:42.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.142+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:40:42.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.161+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:40:42.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.162+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:40:42.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.162+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:40:42.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.222+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:40:42.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.224+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:40:42.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.228+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:40:42.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.229+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:40:42.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:40:42.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.265+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:40:42.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.266+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:40:42.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.279+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:40:42.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.295+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:40:42.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.304+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:40:42.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.323+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:40:42.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.325+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:40:42.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.346+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:40:42.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.349+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:40:42.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.360+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:40:42.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.368+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:40:42.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.378+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:40:42.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.380+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:40:42.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.410+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:40:42.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.427+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:40:42.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.436+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:40:42.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.456+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:40:42.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.463+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:40:42.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:40:42.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.474+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:40:42.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.483+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:40:42.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.498+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:40:42.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.507+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:40:42.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.508+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:40:42.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.546+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:40:42.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.547+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:42.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:40:42.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.582+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:40:42.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:40:42.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.607+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:42.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.629+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:42.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.632+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:40:42.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.637+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:40:42.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.646+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:40:42.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.666+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:40:42.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.672+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:40:42.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.687+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:40:42.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.688+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:40:42.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.692+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:40:42.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.696+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:40:42.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.699+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:40:42.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.728+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:40:42.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.729+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:40:42.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.743+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:40:42.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.747+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:40:42.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 259 16 3510158 3510142 846.965 782.812 0.00108084 0.00116994 2024-09-17T16:40:42.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.757+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:40:42.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.765+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:40:42.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.773+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:40:42.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.776+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:40:42.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.804+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:40:42.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.809+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:40:42.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.838+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:40:42.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.841+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:40:42.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.855+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:40:42.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.879+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:40:42.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.880+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:40:42.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.885+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:40:42.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.893+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:40:42.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.895+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:40:42.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.903+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:40:42.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.906+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:40:42.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.959+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:40:42.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.966+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:40:42.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.971+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:40:42.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.992+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:40:42.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:42.995+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:40:43.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.004+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:40:43.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.009+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:40:43.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.031+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:40:43.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.041+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:40:43.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.054+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:40:43.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.060+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:40:43.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.066+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:40:43.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.087+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:40:43.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.101+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:43.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.109+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:40:43.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.115+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:40:43.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:40:43.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.161+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:40:43.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.164+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:40:43.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.167+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:43.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.185+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:40:43.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.208+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:40:43.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.212+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:40:43.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.216+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:43.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.225+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:40:43.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.242+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:43.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.258+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:40:43.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.273+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:40:43.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.284+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:40:43.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.309+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:40:43.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.313+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:40:43.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.334+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:40:43.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.341+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:40:43.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.351+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:40:43.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.374+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:40:43.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.374+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:40:43.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.394+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:40:43.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.406+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:40:43.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.425+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:40:43.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.454+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:40:43.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.460+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:40:43.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:40:43.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.495+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:40:43.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.500+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:40:43.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.514+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:40:43.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.517+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:40:43.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.520+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:40:43.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.531+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:40:43.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.543+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:40:43.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.561+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:40:43.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.570+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:40:43.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.589+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:40:43.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.590+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:40:43.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:40:43.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.613+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:40:43.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:40:43.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.621+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:40:43.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.631+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:40:43.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.659+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:43.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.668+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:40:43.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.676+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:40:43.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.683+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:40:43.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.713+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:40:43.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.720+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:40:43.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.728+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:40:43.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.750+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:40:43.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:40:43.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:40:43.759495+0000 min lat: 0.000227768 max lat: 0.222415 avg lat: 0.00116994 2024-09-17T16:40:43.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:40:43.760 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 260 16 3523714 3523698 846.966 847.25 0.000873479 0.00116994 2024-09-17T16:40:43.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.773+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:40:43.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.779+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:40:43.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.796+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:40:43.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.796+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:40:43.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:43.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.818+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:40:43.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.847+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:40:43.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.892+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:40:43.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.895+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:40:43.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.895+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:40:43.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.915+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:40:43.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.918+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:40:43.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.944+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:40:43.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.957+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:40:43.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.960+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:40:43.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.991+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:40:43.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:43.991+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:40:44.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.010+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:40:44.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.012+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:40:44.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.079+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:40:44.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.086+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:40:44.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.088+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:40:44.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.092+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:40:44.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.099+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:40:44.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.131+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:40:44.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.138+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:40:44.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.140+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:40:44.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.165+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:40:44.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.180+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:40:44.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.204+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:40:44.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.206+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:40:44.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.226+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:40:44.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.239+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:40:44.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.241+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:44.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.259+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:40:44.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.267+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:40:44.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.271+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:40:44.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.306+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:40:44.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.314+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:40:44.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.330+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:40:44.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.334+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:40:44.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.354+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:40:44.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.356+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:40:44.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.371+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:40:44.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.382+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:40:44.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.383+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:40:44.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.388+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:40:44.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.399+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:40:44.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.404+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:40:44.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.414+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:40:44.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.420+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:40:44.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.437+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:40:44.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.466+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:40:44.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.482+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:40:44.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.483+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:40:44.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.485+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:40:44.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.488+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:40:44.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.503+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:40:44.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.503+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:40:44.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.564+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:40:44.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.564+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:40:44.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.577+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:40:44.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:40:44.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.593+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:40:44.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.603+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:40:44.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.609+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:40:44.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.632+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:40:44.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.638+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:40:44.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.642+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:40:44.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.645+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:40:44.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:40:44.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.683+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:40:44.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.692+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:40:44.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.699+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:40:44.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.708+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:40:44.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 261 16 3536175 3536159 846.704 778.812 0.000501391 0.00117014 2024-09-17T16:40:44.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.772+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:40:44.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.779+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:44.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.780+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:40:44.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.782+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:40:44.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:40:44.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.835+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:40:44.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.852+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:40:44.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.853+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:40:44.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.863+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:40:44.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.864+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:40:44.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.875+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:40:44.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.883+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:40:44.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.899+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:40:44.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.903+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:40:44.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.925+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:40:44.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.934+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:40:44.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.948+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:40:44.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.949+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:40:44.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.958+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:40:44.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.968+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:40:44.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.982+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:40:44.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:44.986+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:40:45.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.012+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:40:45.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.014+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:40:45.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.020+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:40:45.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.035+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:40:45.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.052+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:40:45.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.052+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:40:45.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.057+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:40:45.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.060+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:40:45.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.093+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:40:45.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.109+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:40:45.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.111+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:40:45.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.114+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:40:45.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.145+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:40:45.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.157+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:45.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.158+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:40:45.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.160+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:40:45.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.167+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:40:45.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:40:45.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.189+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:40:45.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.222+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:40:45.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.226+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:40:45.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:40:45.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.248+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:40:45.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.267+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:40:45.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.272+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:40:45.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.272+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:40:45.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.275+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:40:45.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.293+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:40:45.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.293+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:40:45.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.301+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:40:45.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.322+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:40:45.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.324+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:40:45.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.341+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:40:45.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.355+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:40:45.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.368+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:40:45.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:40:45.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.417+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:45.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.418+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:40:45.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.419+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:40:45.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.434+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:40:45.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.441+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:40:45.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.464+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:45.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.467+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:40:45.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.486+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:40:45.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.501+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:40:45.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.502+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:40:45.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.505+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:40:45.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.516+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:40:45.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.550+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:40:45.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.558+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:40:45.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.569+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:40:45.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.595+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:40:45.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.626+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:40:45.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.629+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:45.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.646+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:40:45.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.649+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:40:45.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.653+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:40:45.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.661+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:40:45.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.662+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:40:45.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.685+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:40:45.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.699+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:40:45.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.703+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:40:45.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 262 16 3549163 3549147 846.57 811.75 0.0013269 0.00117033 2024-09-17T16:40:45.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.719+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:40:45.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:40:45.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.766+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:40:45.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.808+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:45.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.832+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:40:45.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.833+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:40:45.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.840+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:40:45.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.841+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:40:45.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.864+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:40:45.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.882+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:40:45.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.890+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:40:45.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.890+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:40:45.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.892+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:40:45.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.943+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:40:45.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.959+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:40:45.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.963+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:40:45.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.979+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:40:45.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:45.989+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:40:46.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.008+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:40:46.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.012+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:40:46.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:40:46.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.029+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:40:46.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.043+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:40:46.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.059+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:40:46.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:40:46.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.079+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:40:46.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.090+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:40:46.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.092+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:40:46.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.122+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:40:46.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.143+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:40:46.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.145+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:40:46.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.152+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:40:46.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.157+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:40:46.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.190+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:40:46.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.194+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:40:46.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.197+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:40:46.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.235+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:40:46.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.239+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:40:46.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.246+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:40:46.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.248+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:40:46.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.255+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:40:46.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.261+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:40:46.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.295+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:40:46.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.296+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:40:46.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.302+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:40:46.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.327+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:40:46.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.331+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:40:46.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.351+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:40:46.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.357+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:40:46.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.366+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:40:46.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.366+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:40:46.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.370+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:40:46.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.403+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:40:46.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.407+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:40:46.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.421+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:40:46.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.443+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:40:46.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.446+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:40:46.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.458+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:40:46.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.459+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:40:46.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.466+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:40:46.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.492+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:40:46.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.493+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:40:46.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.502+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:40:46.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.514+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:40:46.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.540+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:40:46.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.543+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:40:46.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.545+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:40:46.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.555+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:40:46.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.560+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:40:46.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.566+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:40:46.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.583+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:40:46.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.601+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:40:46.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.612+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:40:46.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.619+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:40:46.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.633+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:40:46.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.633+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:40:46.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:40:46.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.675+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:40:46.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.678+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:40:46.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.701+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:40:46.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.717+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:40:46.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.718+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:40:46.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.720+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:40:46.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.740+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:40:46.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.752+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:40:46.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 263 16 3562773 3562757 846.585 850.625 0.0016903 0.00117047 2024-09-17T16:40:46.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.765+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:40:46.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.771+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:40:46.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.791+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:40:46.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.792+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:40:46.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.798+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:40:46.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.803+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:40:46.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.817+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:40:46.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.817+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:40:46.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.844+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:40:46.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.868+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:40:46.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.880+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:40:46.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.881+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:40:46.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.888+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:40:46.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.899+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:40:46.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.925+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:40:46.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.937+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:40:46.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.951+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:40:46.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.965+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:40:46.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.968+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:40:46.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.985+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:40:46.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.988+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:40:47.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:46.999+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:40:47.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.005+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:40:47.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.054+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:40:47.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.055+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:40:47.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.065+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:40:47.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.066+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:40:47.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.067+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:40:47.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.103+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:40:47.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.115+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:47.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.138+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:40:47.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.143+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:40:47.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.150+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:40:47.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.152+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:40:47.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.173+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:40:47.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.179+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:40:47.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.183+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:40:47.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.190+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:40:47.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.199+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:40:47.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.240+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:40:47.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.241+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:40:47.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.256+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:40:47.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.258+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:47.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.260+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:40:47.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.280+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:40:47.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.288+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:40:47.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.299+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:40:47.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.319+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:40:47.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.319+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:40:47.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.320+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:40:47.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.330+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:40:47.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.347+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:40:47.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.358+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:40:47.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.362+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:40:47.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.381+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:40:47.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.405+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:40:47.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.417+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:40:47.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.419+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:40:47.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.423+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:40:47.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.427+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:40:47.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.435+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:40:47.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.467+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:40:47.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.476+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:40:47.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.488+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:40:47.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.501+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:40:47.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.505+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:40:47.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.512+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:40:47.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.520+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:40:47.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.549+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:40:47.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.588+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:40:47.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.592+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:40:47.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.595+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:40:47.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.612+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:47.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.612+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:40:47.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.613+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:40:47.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.618+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:40:47.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.629+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:40:47.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.633+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:40:47.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.649+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:40:47.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.651+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:40:47.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.658+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:40:47.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.686+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:40:47.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.694+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:40:47.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.719+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:40:47.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.753+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:40:47.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.757+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:40:47.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 264 16 3575819 3575803 846.467 815.375 0.000792806 0.00117064 2024-09-17T16:40:47.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.765+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:40:47.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.768+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:40:47.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.791+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:47.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.804+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:40:47.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.805+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:40:47.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.825+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:40:47.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.831+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:40:47.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.832+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:40:47.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.854+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:40:47.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.885+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:40:47.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.893+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:40:47.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.900+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:47.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.910+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:40:47.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.914+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:40:47.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.922+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:40:47.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.932+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:40:47.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.937+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:40:47.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.953+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:40:47.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:47.992+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:40:48.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.008+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:40:48.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.027+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:40:48.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.034+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:40:48.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:40:48.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.056+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:40:48.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.060+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:48.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.090+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:40:48.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.115+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:40:48.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.119+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:40:48.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.136+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:40:48.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.146+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:40:48.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:40:48.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.168+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:40:48.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.182+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:40:48.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.184+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:48.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.197+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:40:48.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.205+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:40:48.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.231+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:40:48.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:40:48.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.236+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:40:48.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.258+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:40:48.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.265+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:40:48.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.283+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:40:48.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.285+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:40:48.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.294+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:40:48.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.301+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:40:48.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.331+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:40:48.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.346+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:40:48.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.359+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:40:48.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.361+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:40:48.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.384+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:40:48.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.406+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:40:48.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.414+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:40:48.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.431+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:40:48.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.449+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:40:48.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.450+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:40:48.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.467+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:40:48.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.476+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:40:48.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.484+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:40:48.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.493+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:40:48.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.496+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:40:48.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.534+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:40:48.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.536+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:40:48.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.544+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:40:48.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.572+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:40:48.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.573+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:40:48.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.577+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:48.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.587+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:40:48.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.598+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:40:48.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.621+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:40:48.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.625+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:40:48.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.626+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:40:48.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.642+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:40:48.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.653+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:40:48.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.675+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:40:48.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.680+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:40:48.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.702+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:40:48.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.702+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:40:48.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.715+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:40:48.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:40:48.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.721+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:40:48.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.737+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:40:48.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 265 16 3589492 3589476 846.497 854.562 0.000584243 0.00117059 2024-09-17T16:40:48.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.774+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:40:48.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.796+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:40:48.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.800+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:40:48.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.825+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:40:48.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.857+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:40:48.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.859+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:40:48.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.875+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:40:48.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.890+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:40:48.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.900+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:40:48.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.905+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:40:48.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.915+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:40:48.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.926+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:40:48.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.953+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:40:48.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.976+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:40:48.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:48.987+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:40:49.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.002+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:40:49.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.004+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:40:49.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.012+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:40:49.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.037+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:40:49.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.041+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:40:49.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.045+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:40:49.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.077+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:40:49.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.084+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:40:49.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.103+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:40:49.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.122+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:40:49.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.135+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:49.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.138+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:40:49.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.143+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:40:49.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.172+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:40:49.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.180+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:40:49.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.190+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:40:49.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.191+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:40:49.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.197+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:40:49.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.200+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:40:49.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.203+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:40:49.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.213+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:40:49.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.220+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:40:49.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.248+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:40:49.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.263+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:40:49.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.274+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:40:49.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.284+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:40:49.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.285+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:40:49.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.296+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:40:49.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.297+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:40:49.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.299+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:40:49.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.306+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:40:49.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.330+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:40:49.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.335+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:40:49.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.353+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:40:49.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.361+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:40:49.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.366+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:40:49.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.370+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:40:49.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.379+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:40:49.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.392+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:49.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.418+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:40:49.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.419+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:40:49.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.438+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:40:49.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.453+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:40:49.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.464+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:40:49.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.466+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:40:49.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.478+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:40:49.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.497+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:40:49.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.499+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:40:49.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.511+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:40:49.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.518+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:40:49.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.532+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:40:49.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.552+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:40:49.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.566+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:40:49.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.569+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:40:49.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.572+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:40:49.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.594+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:40:49.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.616+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:40:49.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.630+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:40:49.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.630+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:40:49.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.637+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:40:49.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.658+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:40:49.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.663+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:40:49.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.681+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5986f48:::benchmark_data_smithi165_34272_object937:head, will try copies on 2,3 2024-09-17T16:40:49.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.690+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:40:49.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.705+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:40:49.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:40:49.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.726+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:40:49.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.740+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:40:49.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.758+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:40:49.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 266 15 3603389 3603374 846.58 868.625 0.000621064 0.00117048 2024-09-17T16:40:49.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.774+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:40:49.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.783+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:40:49.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.787+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:40:49.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.805+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:40:49.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.838+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:40:49.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.840+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:40:49.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.854+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:40:49.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.869+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:40:49.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.872+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:40:49.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.888+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:40:49.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.890+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:40:49.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.897+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:40:49.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.916+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:40:49.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.921+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:40:49.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.927+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:40:49.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.942+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:40:49.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.950+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:40:49.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.961+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:40:49.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.969+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:40:49.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.980+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:40:49.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:49.997+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:40:50.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.005+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:40:50.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.007+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:40:50.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.023+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:40:50.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.043+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:40:50.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.044+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:40:50.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.045+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:40:50.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.060+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:40:50.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.071+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:40:50.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.114+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:40:50.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.138+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:40:50.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.139+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:40:50.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.149+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:40:50.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.166+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:50.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.197+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:40:50.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.198+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:40:50.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.200+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:40:50.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.219+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:40:50.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:40:50.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.227+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:40:50.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.229+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:40:50.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.240+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:40:50.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:40:50.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.271+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:40:50.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.298+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:40:50.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.304+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:40:50.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.309+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:40:50.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.316+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:40:50.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.323+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:40:50.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.333+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:40:50.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.352+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:40:50.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.363+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:40:50.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.365+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:40:50.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.392+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:40:50.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.393+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:40:50.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.412+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:40:50.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.415+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:40:50.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.435+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:40:50.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.446+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:40:50.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.453+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:40:50.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.466+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:40:50.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.487+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:40:50.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.489+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:40:50.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.501+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:40:50.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.502+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:40:50.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.516+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:40:50.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.526+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:40:50.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.530+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:40:50.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.535+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:40:50.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.544+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:40:50.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.576+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:40:50.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.576+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:40:50.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.580+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:40:50.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.584+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:40:50.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.608+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:40:50.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.613+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:40:50.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.620+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:40:50.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.623+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:40:50.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.643+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:40:50.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.651+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:40:50.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.667+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:40:50.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.688+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:40:50.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.689+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:40:50.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.697+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:40:50.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.707+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:40:50.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.715+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:40:50.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.757+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:40:50.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 267 16 3616594 3616578 846.5 825.25 0.000743928 0.00117057 2024-09-17T16:40:50.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.766+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:40:50.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.792+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:40:50.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.794+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:40:50.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.817+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:40:50.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.818+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:40:50.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.821+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:40:50.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.833+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:40:50.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.847+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:40:50.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.851+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:40:50.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.872+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:40:50.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.884+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:40:50.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.892+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:40:50.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.904+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:40:50.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.905+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:40:50.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.927+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:40:50.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.935+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:40:50.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.944+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:40:50.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.950+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:40:50.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:50.955+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:40:51.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.041+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:40:51.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.049+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:40:51.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.063+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:40:51.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.069+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:40:51.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.069+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:40:51.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.087+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:40:51.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:40:51.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.101+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:40:51.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.101+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:40:51.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.135+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:40:51.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:40:51.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.162+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:40:51.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.163+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:40:51.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.164+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:40:51.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.174+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:40:51.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.188+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:40:51.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.193+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:40:51.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.223+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:40:51.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.254+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:40:51.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.262+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:40:51.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.274+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:40:51.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.279+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:40:51.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.291+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:40:51.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.316+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:40:51.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.323+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:40:51.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.330+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:40:51.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.340+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:40:51.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.346+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:40:51.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.348+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:40:51.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.352+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:40:51.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.377+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:51.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.382+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:40:51.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.385+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:40:51.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:40:51.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.428+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:40:51.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:40:51.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.450+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:40:51.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.461+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:40:51.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.470+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:40:51.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.486+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:40:51.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.513+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:40:51.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.517+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:40:51.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.519+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:40:51.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.525+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:40:51.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.527+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:40:51.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.535+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:40:51.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.556+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:40:51.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.564+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:40:51.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.597+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:40:51.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.615+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:40:51.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.616+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:40:51.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.630+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:40:51.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.641+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:40:51.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.647+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:40:51.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:40:51.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.679+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:40:51.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.685+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:40:51.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.719+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:40:51.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.727+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:40:51.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.733+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:40:51.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.747+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:40:51.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.755+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:40:51.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 268 16 3629613 3629597 846.377 813.688 0.000731131 0.00117076 2024-09-17T16:40:51.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.766+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:40:51.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.778+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:40:51.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.787+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:40:51.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.814+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:40:51.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.831+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:40:51.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.836+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:40:51.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.849+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:40:51.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.867+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:40:51.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.869+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:40:51.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.873+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:40:51.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.888+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:40:51.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.916+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:40:51.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.925+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:40:51.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.929+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:40:51.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.931+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:40:51.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.938+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:40:51.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.966+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:40:51.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.968+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:40:51.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.973+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:40:51.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.982+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:40:51.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:51.994+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:40:52.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.018+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:40:52.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.025+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:40:52.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.081+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:40:52.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.083+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:40:52.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.100+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:40:52.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.117+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:40:52.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.132+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:40:52.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.152+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:40:52.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.152+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:40:52.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.164+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:40:52.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.165+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:40:52.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.178+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:40:52.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.180+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:40:52.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.202+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:52.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.217+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:40:52.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.237+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:40:52.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.241+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:40:52.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.252+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:40:52.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.259+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:40:52.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.263+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:40:52.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.272+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:40:52.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.276+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:40:52.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.280+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:40:52.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.287+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:40:52.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.328+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:40:52.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.348+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:40:52.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.353+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:40:52.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.361+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:40:52.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.390+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:40:52.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.405+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:52.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.408+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:40:52.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.408+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:40:52.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.423+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:40:52.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.424+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:40:52.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.435+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:40:52.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.453+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:40:52.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.459+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:40:52.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.460+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:40:52.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.469+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:52.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.471+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:40:52.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.508+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:40:52.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.524+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:40:52.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.535+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:40:52.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.540+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:40:52.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.553+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:40:52.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.568+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:40:52.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.573+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:40:52.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.586+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:40:52.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.593+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:40:52.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.597+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:40:52.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.621+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:40:52.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.642+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:52.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.643+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:40:52.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.672+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:40:52.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.681+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:40:52.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.700+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:40:52.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.708+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:40:52.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.710+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:40:52.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.716+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:40:52.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.736+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:40:52.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.756+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:40:52.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 269 16 3642936 3642920 846.326 832.688 0.000853279 0.00117084 2024-09-17T16:40:52.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.764+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:40:52.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.770+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:40:52.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.780+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:40:52.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.783+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:40:52.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.799+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:40:52.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.812+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:40:52.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.822+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:40:52.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.841+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:40:52.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.847+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:40:52.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.856+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:40:52.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.871+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:40:52.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.887+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:40:52.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.894+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:40:52.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.905+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:40:52.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.906+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:40:52.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.921+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:40:52.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.934+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:40:52.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.941+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:40:52.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.955+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:40:52.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.970+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:40:52.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.974+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:52.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:52.990+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:40:53.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.022+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:40:53.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.040+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:40:53.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.053+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:40:53.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.054+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:40:53.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.055+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:40:53.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.060+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:40:53.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.089+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:40:53.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.103+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:40:53.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.113+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:40:53.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.132+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:40:53.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.136+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:40:53.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.147+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:40:53.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.171+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:40:53.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.173+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:40:53.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.174+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:40:53.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.198+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:40:53.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:40:53.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.208+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:40:53.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.227+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:40:53.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.236+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:40:53.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.239+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:40:53.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.251+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:40:53.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.262+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:40:53.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.269+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:40:53.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.272+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:40:53.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.276+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:40:53.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.279+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:40:53.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.301+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:40:53.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.308+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:40:53.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.314+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:40:53.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.321+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:40:53.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.326+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:40:53.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.347+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:40:53.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.347+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:40:53.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.349+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:40:53.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.359+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:40:53.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.379+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:40:53.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.385+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:40:53.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.423+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:40:53.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.432+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:40:53.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.485+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:40:53.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.498+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:40:53.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.505+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:40:53.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.506+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:40:53.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.526+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:40:53.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.529+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:40:53.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.531+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:40:53.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.560+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:40:53.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.567+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:40:53.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.570+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:40:53.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.584+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:40:53.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.598+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:40:53.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.617+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:40:53.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.623+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:40:53.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.633+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:40:53.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.643+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:40:53.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.664+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:40:53.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.666+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:40:53.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.674+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:53.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.677+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:40:53.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.694+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:40:53.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.709+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:40:53.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.725+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:40:53.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.727+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:40:53.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.730+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:40:53.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.736+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:40:53.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 270 16 3656124 3656108 846.244 824.25 0.000801517 0.00117094 2024-09-17T16:40:53.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.761+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:40:53.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.780+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:40:53.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.786+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50e165b:::benchmark_data_smithi165_34272_object3287:head, will try copies on 2,3 2024-09-17T16:40:53.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.793+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:40:53.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.805+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:40:53.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.812+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:40:53.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.836+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:40:53.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.838+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:40:53.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.841+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:40:53.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.848+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:40:53.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.875+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:40:53.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.896+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:40:53.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.897+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:40:53.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.899+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:40:53.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.936+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:40:53.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.958+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:40:53.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.959+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:40:53.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:53.979+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:40:54.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.009+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:40:54.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.011+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:40:54.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.011+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:40:54.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.027+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:40:54.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.033+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:40:54.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.037+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:40:54.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.049+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:40:54.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.062+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:40:54.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.073+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:54.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.076+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:40:54.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.091+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:40:54.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.102+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:40:54.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.110+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:40:54.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.132+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:40:54.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.141+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:40:54.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.154+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:40:54.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.155+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:40:54.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.158+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:40:54.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.191+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:40:54.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.206+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:40:54.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.216+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:40:54.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.222+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:40:54.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.243+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:40:54.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.260+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:40:54.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.272+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:40:54.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.285+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:40:54.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.287+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:40:54.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:40:54.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.321+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:40:54.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.326+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:40:54.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.342+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:40:54.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.355+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:40:54.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.366+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:40:54.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.378+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:40:54.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.393+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:40:54.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.395+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:40:54.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.435+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:40:54.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.456+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:40:54.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.460+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:40:54.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.470+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:40:54.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.479+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:40:54.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.493+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:40:54.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.494+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:40:54.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.505+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:40:54.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.539+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:40:54.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.547+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:40:54.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.558+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:40:54.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.561+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:40:54.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.570+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:40:54.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.604+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:40:54.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.620+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:40:54.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.623+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:40:54.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.625+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:40:54.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.635+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:40:54.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.648+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:40:54.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.671+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:40:54.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.693+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:40:54.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.695+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:40:54.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.716+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:40:54.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.734+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:40:54.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.742+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:40:54.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 271 15 3670499 3670484 846.436 898.5 0.000734423 0.00117068 2024-09-17T16:40:54.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.760+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:40:54.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.768+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:40:54.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.781+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:40:54.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.783+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:40:54.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.797+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:40:54.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.799+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:40:54.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.815+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:40:54.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.818+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:40:54.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.823+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:40:54.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.828+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:40:54.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.831+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:40:54.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.841+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:40:54.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.863+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:40:54.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.877+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:40:54.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.890+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:40:54.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.895+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:40:54.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.912+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:40:54.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.922+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:40:54.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.935+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:40:54.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.942+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:40:54.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.974+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:40:54.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:54.977+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:40:55.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.018+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:40:55.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.023+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:40:55.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.039+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:40:55.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.069+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:40:55.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.070+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:40:55.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.071+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:40:55.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.096+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:40:55.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.114+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:40:55.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.114+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:40:55.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.122+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:40:55.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.128+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:40:55.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.150+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:40:55.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.168+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:40:55.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.173+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:40:55.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.195+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:40:55.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.198+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:40:55.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.204+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:40:55.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.212+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:40:55.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.226+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:40:55.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.229+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:40:55.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.265+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:40:55.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.269+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:40:55.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.292+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:40:55.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.294+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:40:55.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.300+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:40:55.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.322+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:40:55.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.324+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:40:55.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.331+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:40:55.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.335+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:40:55.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.343+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:40:55.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.358+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:40:55.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.372+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:40:55.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.385+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:40:55.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.397+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:40:55.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:40:55.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.421+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:55.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.435+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:40:55.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.448+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:40:55.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.461+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:40:55.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.474+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:40:55.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.481+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:40:55.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.482+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:40:55.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.507+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:55.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.511+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:40:55.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.512+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:40:55.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.542+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:40:55.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.575+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:40:55.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.577+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:40:55.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.593+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:40:55.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.608+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:40:55.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.612+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:40:55.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.617+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:40:55.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.629+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:40:55.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.637+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:55.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.646+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:40:55.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.661+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:40:55.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.678+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:40:55.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.701+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:40:55.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.724+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:40:55.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.731+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:40:55.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.742+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:40:55.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.745+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:40:55.761 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 272 16 3684329 3684313 846.502 864.312 0.00113756 0.00117058 2024-09-17T16:40:55.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.768+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:40:55.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.768+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:40:55.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.784+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:40:55.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.803+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:40:55.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.817+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:40:55.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.818+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:40:55.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.821+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:40:55.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.824+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:40:55.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.835+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:40:55.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.853+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:40:55.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.874+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:40:55.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:40:55.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.900+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:40:55.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.917+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:40:55.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.923+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:55.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.932+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:40:55.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.955+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:40:55.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.966+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:40:55.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.973+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:40:55.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.976+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:40:55.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.993+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:40:56.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:55.999+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:40:56.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.011+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:40:56.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.039+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:40:56.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.059+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:40:56.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.071+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:40:56.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.072+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:56.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.079+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:40:56.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.098+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:40:56.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.103+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:40:56.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.103+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:40:56.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.124+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:40:56.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.141+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:40:56.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.147+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:40:56.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.149+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:40:56.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.176+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:40:56.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.177+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:40:56.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.182+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:40:56.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.186+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:40:56.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.194+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:40:56.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.236+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:40:56.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.238+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:40:56.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.244+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:40:56.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.250+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:40:56.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.256+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:40:56.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.262+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:40:56.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.285+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:40:56.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.301+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:40:56.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.315+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:40:56.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.320+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:40:56.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.340+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:40:56.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.346+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:40:56.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.357+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:40:56.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:40:56.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.392+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:40:56.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.409+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:40:56.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.419+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:40:56.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.432+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:40:56.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.443+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:40:56.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:40:56.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.460+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:40:56.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.470+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:40:56.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.475+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:40:56.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.483+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:40:56.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.485+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:40:56.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.504+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:40:56.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.520+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:40:56.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.523+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:40:56.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.526+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:40:56.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.526+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:40:56.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.551+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:40:56.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.554+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:40:56.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.584+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:40:56.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.597+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:40:56.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.607+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:40:56.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.617+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:40:56.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:40:56.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.639+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:40:56.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.645+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:40:56.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.647+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:40:56.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.665+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:40:56.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.672+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:40:56.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.682+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:40:56.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.703+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:40:56.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.704+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:40:56.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.720+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:40:56.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.725+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:40:56.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.747+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:40:56.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 273 15 3697944 3697929 846.518 851 0.000533447 0.00117056 2024-09-17T16:40:56.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.764+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:40:56.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.764+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:40:56.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.773+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:40:56.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.785+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:40:56.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.802+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91d1150f:::benchmark_data_smithi165_34272_object1556:head, will try copies on 0,4 2024-09-17T16:40:56.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.803+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:40:56.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.807+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:40:56.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.830+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:40:56.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.837+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:40:56.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.874+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:40:56.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.875+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:40:56.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.881+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:40:56.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.890+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:40:56.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.912+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:40:56.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.916+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:40:56.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.928+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:40:56.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.930+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:40:56.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.964+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:40:56.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.964+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:40:56.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.991+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:40:56.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:56.995+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:40:57.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.029+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:40:57.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.039+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:40:57.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.042+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:40:57.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.047+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:40:57.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.054+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:40:57.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.074+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:40:57.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.083+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:40:57.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.084+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:40:57.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.085+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:40:57.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.089+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:40:57.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.101+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:40:57.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.104+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:40:57.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.135+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:40:57.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.137+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:40:57.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.149+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:40:57.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.149+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:40:57.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.162+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:40:57.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.181+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:40:57.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.200+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:40:57.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.201+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:40:57.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.202+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:40:57.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.221+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:40:57.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.233+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:57.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.254+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:40:57.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.262+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:40:57.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.267+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:40:57.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.281+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:40:57.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.283+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:40:57.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.287+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:40:57.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.298+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:40:57.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.313+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:40:57.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.330+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:40:57.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.333+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:40:57.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.348+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:40:57.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.361+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:40:57.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.390+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:40:57.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.392+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:40:57.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.416+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:40:57.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.430+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:40:57.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.437+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:40:57.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.440+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:40:57.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.450+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:40:57.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.453+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:40:57.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.488+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:40:57.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.494+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:40:57.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.513+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:40:57.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.524+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:40:57.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.535+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:40:57.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.539+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:40:57.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.551+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:40:57.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.552+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:40:57.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.565+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:40:57.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.577+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:40:57.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.583+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:40:57.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:40:57.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.633+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:40:57.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.656+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:40:57.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.671+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:40:57.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.684+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:40:57.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.691+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:40:57.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.692+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:40:57.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.704+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:40:57.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.706+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:40:57.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.712+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:40:57.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.742+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:40:57.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.748+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:40:57.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 274 16 3711833 3711817 846.596 868 0.00128927 0.00117046 2024-09-17T16:40:57.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.775+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:40:57.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.784+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:40:57.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.787+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:40:57.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.790+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:40:57.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.810+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:40:57.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.812+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:40:57.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.829+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:40:57.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.851+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:40:57.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.852+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:40:57.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.858+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:40:57.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.876+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:40:57.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.885+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:40:57.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.886+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:40:57.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.898+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:40:57.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.918+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:40:57.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.924+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:40:57.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.951+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:40:57.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.965+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:40:58.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:57.997+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:40:58.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.012+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:58.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:40:58.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.018+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:40:58.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.020+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:40:58.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.038+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:58.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.072+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:40:58.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.083+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:40:58.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.091+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:40:58.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.099+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:40:58.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.100+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:40:58.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.109+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:40:58.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.129+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:40:58.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.133+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:40:58.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.147+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:40:58.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.154+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:40:58.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.169+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:40:58.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.172+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:40:58.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.176+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:40:58.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.205+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:40:58.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.234+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:40:58.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.249+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:40:58.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.260+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:40:58.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.266+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:40:58.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.271+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:40:58.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.279+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:40:58.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.313+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:40:58.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.344+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:40:58.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.345+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:40:58.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.347+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:40:58.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.349+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:40:58.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.363+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:40:58.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.400+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:40:58.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.402+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:40:58.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:40:58.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.423+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:40:58.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.441+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:40:58.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.458+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:40:58.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.459+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:40:58.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.483+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:40:58.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.484+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:40:58.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.496+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:40:58.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.511+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:40:58.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.513+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:40:58.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.526+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:40:58.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.540+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:40:58.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.540+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:40:58.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.554+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:40:58.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.557+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:40:58.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.589+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:40:58.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.605+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:40:58.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.627+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:40:58.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.634+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:40:58.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:40:58.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.654+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:40:58.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.661+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:40:58.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.676+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:40:58.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.684+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:40:58.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.701+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:40:58.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:40:58.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.728+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:40:58.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.736+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:40:58.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.744+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:40:58.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 275 16 3725585 3725569 846.643 859.5 0.00165372 0.00117039 2024-09-17T16:40:58.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.765+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:40:58.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.766+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:40:58.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.766+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:40:58.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.786+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:40:58.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.792+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:40:58.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.799+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:40:58.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.803+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:40:58.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.806+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:40:58.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.809+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:40:58.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.824+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:40:58.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.839+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:40:58.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.855+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:40:58.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.861+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:40:58.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.892+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:40:58.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.892+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:40:58.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.909+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:40:58.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.930+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:40:58.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.932+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:40:58.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.957+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:40:58.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.959+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:40:58.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.961+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:40:58.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.968+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:40:58.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:58.983+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:40:59.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.003+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:40:59.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.013+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:40:59.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.017+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:40:59.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.020+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:40:59.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.045+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:40:59.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.056+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:40:59.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.064+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:40:59.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.065+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:40:59.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.074+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:40:59.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.094+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:40:59.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.095+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:40:59.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.109+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:40:59.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.124+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:40:59.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.131+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:40:59.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.137+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:40:59.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.167+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:40:59.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.189+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:40:59.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.194+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:40:59.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.194+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:40:59.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.208+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:40:59.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.214+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:40:59.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.229+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:40:59.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.242+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:40:59.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.248+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:40:59.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.272+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:40:59.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.288+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:40:59.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.290+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:40:59.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.302+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:40:59.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.307+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:40:59.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.322+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:40:59.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.331+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:40:59.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.338+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:40:59.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.362+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:40:59.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.419+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7df710:::benchmark_data_smithi165_34272_object4346:head, will try copies on 2,3 2024-09-17T16:40:59.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.419+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:40:59.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.429+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:40:59.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.442+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:40:59.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.457+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:40:59.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.469+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:40:59.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.484+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:501de1e2:::benchmark_data_smithi165_34272_object1243:head, will try copies on 3,4 2024-09-17T16:40:59.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.498+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:40:59.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.508+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:40:59.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.528+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:40:59.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.538+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:40:59.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.544+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:40:59.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.547+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:40:59.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.552+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:40:59.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.561+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:40:59.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.586+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:40:59.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.598+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:40:59.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.612+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:40:59.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.624+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:40:59.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.631+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:40:59.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.646+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:40:59.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.680+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:40:59.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.680+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:40:59.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.691+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:40:59.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.693+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:40:59.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.698+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:40:59.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.704+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:40:59.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.705+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:40:59.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.727+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:40:59.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.730+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:40:59.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:40:59.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 276 16 3738101 3738085 846.409 782.25 0.00108381 0.00117071 2024-09-17T16:40:59.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.768+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:40:59.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.791+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:40:59.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.813+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:40:59.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:40:59.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.825+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:40:59.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.832+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:40:59.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.840+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:40:59.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.875+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:40:59.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.877+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:40:59.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.877+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:40:59.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.877+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:40:59.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.905+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:40:59.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.940+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:40:59.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.950+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:40:59.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.951+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:40:59.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:40:59.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:40:59.995+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:41:00.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.009+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:41:00.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.022+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:00.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.027+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:41:00.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.038+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:41:00.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.050+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:41:00.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.052+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:41:00.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.054+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:41:00.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.078+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:41:00.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.080+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:00.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.099+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:41:00.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.100+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:41:00.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.114+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:41:00.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.121+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:41:00.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.127+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:41:00.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.153+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:41:00.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.161+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:41:00.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.174+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:41:00.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.184+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:41:00.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.190+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:41:00.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.202+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:41:00.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.205+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:41:00.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.217+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:41:00.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.220+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:41:00.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.252+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:41:00.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.257+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:41:00.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.261+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:00.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.270+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:41:00.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.305+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:41:00.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.309+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:41:00.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.319+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:00.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.320+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:41:00.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.340+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:41:00.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.344+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:41:00.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.352+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:41:00.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.364+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:41:00.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.377+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:41:00.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.404+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:41:00.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.422+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:41:00.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.435+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:41:00.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.437+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:41:00.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.442+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:41:00.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:41:00.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.475+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:41:00.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.489+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:41:00.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.494+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:41:00.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.506+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:41:00.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.515+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:41:00.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.515+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:41:00.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.517+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:00.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.532+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:41:00.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.536+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:41:00.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.547+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:41:00.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:41:00.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.564+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:41:00.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.597+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:41:00.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.604+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:00.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.616+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:41:00.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.628+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:41:00.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.628+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:41:00.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.653+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:41:00.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.677+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:41:00.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.683+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:41:00.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.687+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:41:00.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.689+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:41:00.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.698+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:41:00.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 277 16 3751149 3751133 846.297 815.5 0.000422418 0.00117071 2024-09-17T16:41:00.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.776+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:41:00.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.785+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:41:00.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.798+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:41:00.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.810+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:41:00.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.836+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:41:00.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.842+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:41:00.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.864+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:41:00.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.873+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:41:00.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.877+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:00.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.879+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:41:00.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.900+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:41:00.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.924+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:41:00.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.944+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:41:00.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.959+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:00.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.961+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:41:00.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:41:00.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.968+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:41:00.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.980+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:41:00.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:00.997+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:41:01.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.016+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:41:01.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.023+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:41:01.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.025+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:41:01.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.094+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:41:01.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.108+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:41:01.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.114+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:41:01.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.123+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:41:01.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.126+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:41:01.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.154+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:41:01.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.168+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:41:01.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.176+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:41:01.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.185+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:41:01.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.201+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:41:01.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.208+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:41:01.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.219+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:41:01.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.243+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:41:01.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.244+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:41:01.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.244+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:41:01.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.251+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:41:01.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.267+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:01.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.268+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:01.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.299+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:41:01.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.304+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:41:01.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.307+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:41:01.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.322+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:01.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.388+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:41:01.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.406+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:41:01.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.425+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:41:01.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.433+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:41:01.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.435+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:41:01.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.452+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:41:01.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.457+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:41:01.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.474+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:41:01.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.475+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:41:01.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.485+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:41:01.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.486+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:41:01.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.503+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:41:01.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.518+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:41:01.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.532+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:41:01.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.532+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:41:01.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.555+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:41:01.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.575+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:01.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.575+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:41:01.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.601+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:41:01.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.604+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:41:01.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.607+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:41:01.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.627+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:41:01.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.640+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:41:01.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.641+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:41:01.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.646+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:41:01.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.659+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:41:01.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.686+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:41:01.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.686+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:41:01.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.686+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:41:01.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.702+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:41:01.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.703+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:41:01.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.724+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:41:01.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.730+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:41:01.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.747+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:41:01.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.753+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:41:01.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 278 15 3763539 3763524 846.038 774.438 0.000601391 0.00117123 2024-09-17T16:41:01.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.791+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:41:01.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.792+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:41:01.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.802+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:41:01.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.810+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:41:01.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.821+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:41:01.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.833+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:41:01.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.838+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:41:01.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.854+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:01.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.855+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:01.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.856+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:41:01.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.877+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:41:01.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.881+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:41:01.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.901+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:41:01.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.920+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:41:01.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.943+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:01.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.965+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:41:01.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.980+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:41:01.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.982+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:41:01.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:01.987+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:41:02.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.002+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:41:02.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.012+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:41:02.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.025+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:41:02.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.034+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:41:02.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.048+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:02.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.066+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:41:02.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.069+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:41:02.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.086+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:41:02.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.088+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:41:02.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.109+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:41:02.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.110+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:41:02.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.127+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:02.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.131+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:41:02.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.138+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:41:02.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.159+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:41:02.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.160+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:41:02.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.165+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:41:02.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.182+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:41:02.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.194+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:41:02.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:41:02.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.220+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:41:02.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.231+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:41:02.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:02.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.250+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:41:02.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.266+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:41:02.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.285+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:41:02.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.299+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:41:02.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.317+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:41:02.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.325+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:41:02.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.338+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:41:02.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.341+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:41:02.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.342+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:41:02.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.368+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:41:02.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.369+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:41:02.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.390+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:41:02.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.393+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:41:02.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.396+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:41:02.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.414+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:41:02.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.426+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:41:02.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.453+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:41:02.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.475+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:41:02.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.478+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:41:02.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.486+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:41:02.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.499+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:41:02.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.501+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:02.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.505+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:41:02.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.529+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:41:02.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.534+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:41:02.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.548+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:41:02.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.562+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:41:02.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.579+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:41:02.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.582+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:41:02.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.584+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:41:02.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.598+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:41:02.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.617+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:41:02.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.618+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:41:02.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.671+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:41:02.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.683+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:41:02.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.691+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:41:02.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.699+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:02.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.702+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:41:02.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.704+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:41:02.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.707+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:41:02.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.729+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:41:02.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.741+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:41:02.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.748+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:41:02.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.751+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:41:02.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 279 16 3776858 3776842 845.989 832.375 0.00213527 0.00117128 2024-09-17T16:41:02.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.780+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:41:02.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.790+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:41:02.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.796+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:41:02.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.797+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:41:02.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.808+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:41:02.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:41:02.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.838+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:41:02.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.861+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:41:02.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.883+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:41:02.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.888+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:41:02.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.899+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:41:02.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.912+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:41:02.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.926+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:41:02.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.926+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:41:02.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.932+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:41:02.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.946+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:41:02.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.949+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:41:02.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.973+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:41:02.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.985+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:41:02.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:02.991+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:03.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.006+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:41:03.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.012+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:41:03.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.015+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:41:03.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:41:03.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.041+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:03.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.048+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:41:03.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.060+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:41:03.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.080+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:41:03.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.083+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:41:03.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.116+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:03.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.117+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:41:03.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.132+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:03.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.137+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:41:03.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.155+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:41:03.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.165+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:41:03.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.168+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:41:03.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.194+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:41:03.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.206+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:41:03.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.206+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:41:03.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.209+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:41:03.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.243+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:41:03.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.245+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:41:03.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.246+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:41:03.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.258+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:41:03.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.274+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:41:03.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.279+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:41:03.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.283+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:41:03.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.299+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:41:03.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.302+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:41:03.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.323+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:03.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.330+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:41:03.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.335+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:03.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.347+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:41:03.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.373+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:41:03.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.382+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:41:03.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.384+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:41:03.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.401+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:41:03.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.407+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:41:03.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.408+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:41:03.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.413+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:41:03.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.443+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:41:03.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:41:03.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.455+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:41:03.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.478+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:41:03.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.481+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:41:03.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.487+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:41:03.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.500+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:41:03.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.507+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:41:03.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.510+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:41:03.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.533+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:41:03.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.552+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:41:03.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.553+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:03.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.564+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:41:03.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.586+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:41:03.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.600+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:41:03.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.603+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:41:03.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.607+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:41:03.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.609+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:41:03.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.648+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:41:03.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.649+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:41:03.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.650+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:41:03.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.672+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:41:03.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.676+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:41:03.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.685+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:41:03.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.698+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:41:03.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.722+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:03.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.722+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:41:03.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.728+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:41:03.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.745+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:41:03.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.751+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:41:03.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:41:03.761517+0000 min lat: 0.000227768 max lat: 0.222415 avg lat: 0.00117138 2024-09-17T16:41:03.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:41:03.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 280 16 3790170 3790154 845.939 832 0.00924274 0.00117138 2024-09-17T16:41:03.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.775+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:41:03.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.791+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:41:03.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.801+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:41:03.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.816+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:41:03.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.822+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:41:03.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.835+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:41:03.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.839+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:41:03.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.853+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:41:03.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.882+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:41:03.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.888+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:41:03.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.899+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:41:03.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.905+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:41:03.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.914+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:41:03.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.919+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:41:03.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.945+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:41:03.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.956+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:41:03.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.957+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:41:03.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.960+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:41:03.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.963+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:03.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:03.981+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:41:04.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.003+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:41:04.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.004+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:41:04.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.018+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:41:04.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.030+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:41:04.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.032+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d9e0a5:::benchmark_data_smithi165_34272_object2643:head, will try copies on 3,4 2024-09-17T16:41:04.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.043+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:41:04.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.058+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:41:04.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.060+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:41:04.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.073+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:41:04.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.085+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:41:04.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.102+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:04.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.112+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:41:04.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.119+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:41:04.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.119+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:41:04.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.124+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:41:04.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:41:04.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.170+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:41:04.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.171+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:41:04.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:41:04.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.185+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:41:04.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.185+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:41:04.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.202+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:41:04.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.205+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:41:04.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.234+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:41:04.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.239+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:41:04.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.248+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:41:04.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.279+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:41:04.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:41:04.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.296+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:41:04.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.309+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:41:04.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.311+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:41:04.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.312+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:41:04.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.328+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:41:04.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.356+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:41:04.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.362+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:41:04.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.376+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:04.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.385+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:41:04.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.395+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:41:04.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.399+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:41:04.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.409+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:41:04.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.412+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:41:04.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.440+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:41:04.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.450+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:41:04.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:41:04.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.489+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:41:04.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.490+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:41:04.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.515+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:41:04.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.516+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:04.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.519+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:41:04.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.526+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:41:04.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.546+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:41:04.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.563+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:41:04.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.565+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:41:04.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.585+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:41:04.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.592+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:41:04.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.597+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:41:04.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.614+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:41:04.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.631+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:41:04.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.639+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:41:04.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.656+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:41:04.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:41:04.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.688+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:41:04.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.699+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:41:04.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.711+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:41:04.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.717+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:41:04.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.718+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:41:04.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.731+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:41:04.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.758+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:41:04.762 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 281 15 3803965 3803950 845.997 862.25 0.000719162 0.0011713 2024-09-17T16:41:04.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.784+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:41:04.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.785+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:04.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.804+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:41:04.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.804+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:41:04.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.817+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:04.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.821+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:41:04.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.832+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:41:04.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.838+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:41:04.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.853+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:41:04.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.875+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:04.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.877+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:41:04.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.879+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:41:04.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.882+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:41:04.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.903+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:41:04.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.925+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:41:04.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.926+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:41:04.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.932+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:41:04.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.950+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:41:04.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.966+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:41:04.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.992+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:04.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.993+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:41:04.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:04.997+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:05.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.012+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:41:05.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.022+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:41:05.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.026+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:41:05.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.052+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:41:05.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.057+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:41:05.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.070+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:41:05.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.082+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:41:05.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.092+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:41:05.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.116+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:41:05.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.121+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:41:05.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.127+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:41:05.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.148+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:41:05.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.165+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:41:05.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.168+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:41:05.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.187+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:41:05.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.194+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:41:05.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.195+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:41:05.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.214+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:41:05.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.214+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:05.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.214+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:41:05.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.238+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:41:05.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.259+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:41:05.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.261+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:41:05.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.262+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:41:05.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.274+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:41:05.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.276+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:41:05.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.289+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:41:05.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.315+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:41:05.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.326+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:41:05.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.332+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:41:05.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.334+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:41:05.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.350+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:41:05.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.362+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:41:05.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.376+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:41:05.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.383+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c6064bc:::benchmark_data_smithi165_34272_object606:head, will try copies on 0,4 2024-09-17T16:41:05.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.395+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:41:05.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.401+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:41:05.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.431+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:41:05.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.435+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:41:05.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.437+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:41:05.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.446+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:41:05.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.458+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:41:05.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.464+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:41:05.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.466+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:41:05.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.472+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:41:05.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.490+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:41:05.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.501+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:41:05.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.510+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:41:05.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.512+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:41:05.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.542+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2af0ac65:::benchmark_data_smithi165_34272_object82:head, will try copies on 0,4 2024-09-17T16:41:05.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.546+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:41:05.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.551+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:41:05.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.593+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:41:05.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.594+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:41:05.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.610+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:41:05.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.612+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:41:05.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.621+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:41:05.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.640+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:05.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.648+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:41:05.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.649+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:41:05.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.658+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:41:05.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:41:05.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.679+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:41:05.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.687+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:41:05.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.712+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:41:05.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.712+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:41:05.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.721+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:41:05.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.723+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:41:05.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.732+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:41:05.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 282 16 3816973 3816957 845.879 812.938 0.000611812 0.00117136 2024-09-17T16:41:05.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.790+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:41:05.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.802+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:41:05.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.815+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:41:05.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.831+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:41:05.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.843+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:41:05.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.858+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:41:05.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.874+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:41:05.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.886+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:41:05.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.887+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:41:05.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.906+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:41:05.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.912+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:41:05.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.936+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:05.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.953+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:05.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:41:05.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.966+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:05.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.975+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:41:05.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.982+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:05.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:05.991+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:41:06.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.008+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:41:06.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.008+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:41:06.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.022+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:41:06.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.034+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:41:06.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.045+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:41:06.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.051+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:41:06.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.065+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:41:06.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.096+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:41:06.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.102+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:41:06.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.103+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:41:06.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.137+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:41:06.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.155+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:06.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.164+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:41:06.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.184+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:41:06.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.198+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:41:06.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.203+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:41:06.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.212+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:41:06.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.213+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:41:06.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.229+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:41:06.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.240+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:41:06.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.246+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:41:06.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.284+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:41:06.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.293+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:41:06.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.295+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:41:06.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.298+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:41:06.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.319+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:41:06.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.330+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:41:06.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.333+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:41:06.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:41:06.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.342+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:41:06.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.363+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:41:06.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.392+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:41:06.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.393+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:41:06.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.394+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:41:06.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.401+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:41:06.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:41:06.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:41:06.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.423+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:06.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.449+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:41:06.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.453+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:41:06.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.462+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:41:06.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.469+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:41:06.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.472+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:41:06.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.513+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:41:06.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.527+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:41:06.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.535+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:41:06.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.536+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:41:06.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.547+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:41:06.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.579+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:06.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.583+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:41:06.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.589+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:41:06.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.625+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:41:06.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.636+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:41:06.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.637+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:41:06.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.651+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:41:06.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.664+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:41:06.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.681+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:41:06.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.682+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:41:06.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.685+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:41:06.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.697+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:41:06.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.708+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:06.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.725+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:41:06.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.737+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:41:06.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.744+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:41:06.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.745+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:41:06.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.753+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:41:06.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.756+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:41:06.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 283 16 3830440 3830424 845.864 841.688 0.000521393 0.00117147 2024-09-17T16:41:06.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.767+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:41:06.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.783+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:06.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.783+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:41:06.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.821+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:41:06.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.825+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:41:06.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.828+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:41:06.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.829+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:41:06.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.846+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:41:06.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.860+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:41:06.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.880+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:41:06.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.883+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:41:06.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.890+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:41:06.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.902+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:41:06.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.907+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:41:06.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.923+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:41:06.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.927+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:41:06.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.939+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:41:06.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.942+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:41:06.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.944+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:41:06.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.956+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:41:06.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.965+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:41:06.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.970+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:41:06.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:06.978+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:07.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.013+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:41:07.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.014+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:41:07.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.021+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:07.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.033+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:41:07.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.039+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:41:07.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.043+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:41:07.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.058+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:41:07.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.069+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:41:07.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.089+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:41:07.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.089+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:41:07.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.093+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:41:07.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.111+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:41:07.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.143+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:41:07.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.144+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:41:07.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.149+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:41:07.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.164+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:07.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.177+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:07.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:41:07.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:41:07.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:41:07.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.218+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:41:07.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.224+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:41:07.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.245+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:41:07.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.259+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:41:07.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.266+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:41:07.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.266+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:41:07.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.282+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:41:07.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.305+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:41:07.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.307+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:41:07.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.313+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:41:07.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.314+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:41:07.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:41:07.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.336+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:41:07.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.345+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:41:07.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.348+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:41:07.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.381+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:41:07.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.382+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:41:07.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.390+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:41:07.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.413+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:41:07.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.453+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:41:07.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.459+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:41:07.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.465+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:41:07.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.466+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:41:07.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.477+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:41:07.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.486+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:07.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.503+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:41:07.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.508+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:41:07.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.512+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:41:07.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.535+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:41:07.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.557+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:41:07.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:41:07.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.574+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:41:07.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.574+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:41:07.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:41:07.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.600+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:41:07.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.606+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:07.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.612+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:41:07.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.639+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:41:07.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.649+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:41:07.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.653+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:41:07.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.667+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:41:07.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.684+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:41:07.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.693+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:07.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.712+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:41:07.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:41:07.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.736+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:41:07.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.739+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:41:07.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.740+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:41:07.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.757+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:41:07.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 284 16 3844156 3844140 845.904 857.25 0.000745452 0.00117142 2024-09-17T16:41:07.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.770+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:41:07.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.772+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:41:07.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.774+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:41:07.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.781+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:41:07.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.810+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:07.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.810+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:41:07.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.814+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:41:07.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.834+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:41:07.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.836+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:41:07.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.839+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:41:07.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.856+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:41:07.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.866+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:41:07.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.875+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:41:07.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.900+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:07.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.905+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:41:07.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.919+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:41:07.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.933+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:41:07.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:41:07.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.969+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:07.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.969+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:41:07.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:07.973+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:41:08.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.009+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:41:08.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.009+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:41:08.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.017+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:08.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.023+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:41:08.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.047+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:41:08.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.067+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:41:08.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.079+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:41:08.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.100+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:41:08.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.114+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:41:08.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.134+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:41:08.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.143+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:41:08.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.144+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:41:08.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.162+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:41:08.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.162+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:41:08.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.176+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:41:08.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.194+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:41:08.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.205+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:41:08.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.209+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:41:08.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.228+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:41:08.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.232+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:41:08.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.259+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:41:08.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.281+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:41:08.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.309+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:41:08.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.328+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:41:08.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.329+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:41:08.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.338+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:41:08.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.344+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:08.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.388+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:41:08.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.395+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:41:08.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.419+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:08.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.426+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:41:08.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.428+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:41:08.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.445+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:41:08.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.461+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:41:08.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.478+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:41:08.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.485+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:41:08.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.490+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:41:08.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.498+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:41:08.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.531+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:08.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.534+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:41:08.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.535+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:41:08.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.548+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:41:08.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:41:08.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.597+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:41:08.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.631+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:41:08.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.635+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:41:08.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.643+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:41:08.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.648+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:41:08.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.666+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:41:08.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.681+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:41:08.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.687+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:41:08.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.691+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:41:08.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.696+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:41:08.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.705+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:41:08.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.717+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ec1180:::benchmark_data_smithi165_34272_object2627:head, will try copies on 3,4 2024-09-17T16:41:08.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.744+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:41:08.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.744+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:41:08.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 285 16 3858256 3858240 846.027 881.25 0.000561932 0.00117125 2024-09-17T16:41:08.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.765+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:41:08.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.774+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:41:08.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.776+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:41:08.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.792+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:41:08.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.793+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:41:08.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.820+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5055892:::benchmark_data_smithi165_34272_object2186:head, will try copies on 2,3 2024-09-17T16:41:08.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.822+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:08.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.839+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:41:08.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.846+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:41:08.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.848+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:41:08.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.870+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:41:08.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.872+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:41:08.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.887+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:41:08.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.900+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:41:08.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.906+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:41:08.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.908+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:41:08.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:41:08.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.927+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:41:08.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.933+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:08.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.950+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:41:08.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.953+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:41:08.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.959+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:41:08.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.981+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:41:08.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:08.982+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:41:09.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.001+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:41:09.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.002+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:41:09.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.021+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:41:09.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.036+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:41:09.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.036+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:41:09.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.038+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:41:09.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.042+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:41:09.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.051+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a8fef8:::benchmark_data_smithi165_34272_object1490:head, will try copies on 3,4 2024-09-17T16:41:09.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.066+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:41:09.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.105+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:41:09.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.105+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:41:09.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.106+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:41:09.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.111+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:41:09.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.121+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:41:09.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.140+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:41:09.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.164+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:41:09.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.164+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:41:09.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.180+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:41:09.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.185+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:41:09.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.192+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:41:09.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.195+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:09.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.222+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:41:09.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.226+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:41:09.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.230+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:41:09.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.242+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:41:09.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.261+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:41:09.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.280+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:41:09.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.288+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:41:09.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.305+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:41:09.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.306+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:41:09.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.322+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:41:09.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.323+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:41:09.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.335+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:41:09.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.344+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:41:09.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.372+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:41:09.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.382+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:41:09.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.386+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:41:09.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.402+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:41:09.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.413+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:41:09.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.426+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:41:09.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.444+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:41:09.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.449+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:41:09.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.460+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:09.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:41:09.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.506+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:41:09.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.506+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:41:09.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.530+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:09.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.552+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:41:09.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.552+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:41:09.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.577+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:41:09.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.581+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:41:09.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.581+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:41:09.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.603+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:41:09.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.610+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:41:09.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.611+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:41:09.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.626+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:41:09.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.629+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:41:09.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.645+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:41:09.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.662+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:09.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.680+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:41:09.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.680+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:41:09.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.700+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:41:09.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.702+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:41:09.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.705+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:41:09.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.710+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:41:09.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.724+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:41:09.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.733+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:41:09.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.750+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:41:09.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.754+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:41:09.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 286 16 3871824 3871808 846.034 848 0.0250375 0.00117124 2024-09-17T16:41:09.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.763+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:41:09.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.767+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:09.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.767+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:41:09.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.773+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:09.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.792+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:09.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.799+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:41:09.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.806+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:41:09.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.828+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:41:09.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.847+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:41:09.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.851+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:41:09.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.861+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:41:09.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.872+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:41:09.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.877+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:41:09.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.890+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:41:09.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.911+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:41:09.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.914+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:41:09.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.917+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:41:09.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.932+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:41:09.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.940+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:41:09.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.951+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:41:09.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.972+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:41:09.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:09.981+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:41:10.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.024+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:41:10.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.025+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:41:10.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.033+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:41:10.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.043+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:10.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.045+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:41:10.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.049+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:41:10.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.060+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:41:10.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.077+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:41:10.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.088+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:41:10.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.098+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:41:10.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.101+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:41:10.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.125+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:41:10.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.144+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:41:10.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.164+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:41:10.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.168+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:41:10.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.183+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:41:10.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.186+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:10.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.208+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:41:10.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.214+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:41:10.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.224+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:41:10.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.248+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:41:10.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.249+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:41:10.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.252+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:41:10.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.270+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:41:10.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.272+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:41:10.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.282+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:41:10.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.314+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:41:10.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:41:10.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:41:10.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.333+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:41:10.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.348+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:41:10.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.358+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b1645a8:::benchmark_data_smithi165_34272_object3190:head, will try copies on 3,4 2024-09-17T16:41:10.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.359+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:41:10.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.386+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:41:10.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.398+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:10.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.399+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:41:10.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.412+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:41:10.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.418+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:41:10.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.424+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:10.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.430+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:41:10.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.438+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:41:10.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:41:10.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.461+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:41:10.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.479+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:10.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.489+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:41:10.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.495+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd83ed0:::benchmark_data_smithi165_34272_object4505:head, will try copies on 3,4 2024-09-17T16:41:10.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.514+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:41:10.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.516+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:41:10.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.521+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:41:10.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.535+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:41:10.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.552+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:41:10.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.556+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:41:10.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.563+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:41:10.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.599+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:41:10.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.608+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:41:10.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.623+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:41:10.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.629+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:41:10.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.643+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:41:10.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.666+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:41:10.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.675+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:41:10.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.684+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:41:10.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.691+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:41:10.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.717+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:41:10.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.734+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:41:10.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.749+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd57124:::benchmark_data_smithi165_34272_object1544:head, will try copies on 0,4 2024-09-17T16:41:10.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.757+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:41:10.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 287 16 3885638 3885622 846.094 863.375 0.000627621 0.00117116 2024-09-17T16:41:10.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.762+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:41:10.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.765+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:41:10.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.779+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:41:10.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.798+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:41:10.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.799+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:41:10.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.807+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:41:10.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.826+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:10.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.930+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:41:10.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.933+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:41:10.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.957+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:41:10.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.960+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:41:10.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.963+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:41:10.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.967+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:41:10.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.987+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:41:10.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:10.989+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:41:11.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.012+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:41:11.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.018+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:11.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.026+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:41:11.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.026+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:11.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.046+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:41:11.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.074+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:41:11.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.095+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:41:11.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.099+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:41:11.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.107+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:41:11.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.117+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:41:11.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.135+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:41:11.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.150+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:41:11.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.189+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:41:11.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.191+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:41:11.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.197+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:41:11.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.201+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:41:11.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.203+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:11.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.256+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:41:11.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.287+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:41:11.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.288+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:41:11.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.297+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:41:11.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.310+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:41:11.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.327+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:41:11.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.347+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:41:11.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.352+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:41:11.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.379+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:41:11.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.379+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:11.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.381+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:41:11.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.388+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:41:11.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.409+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:41:11.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.453+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:41:11.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:41:11.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.459+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:41:11.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.465+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:41:11.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.500+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:41:11.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.502+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:11.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.522+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:41:11.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.526+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:41:11.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.537+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:41:11.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.548+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:41:11.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.561+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:41:11.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.563+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:41:11.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.575+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:41:11.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.594+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:11.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.600+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:41:11.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.624+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:41:11.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.626+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:41:11.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.631+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:41:11.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.646+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:41:11.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.669+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:41:11.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.676+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:41:11.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.688+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:41:11.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.699+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:41:11.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.704+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:41:11.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.718+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:41:11.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.735+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:41:11.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.738+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:41:11.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.747+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:41:11.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 288 16 3898276 3898260 845.899 789.875 0.000717705 0.00117143 2024-09-17T16:41:11.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.766+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:41:11.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.781+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:41:11.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.796+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:41:11.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.798+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:41:11.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.814+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:41:11.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.838+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:41:11.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.842+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:41:11.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.843+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:41:11.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.846+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:41:11.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.875+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:41:11.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.903+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:41:11.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.904+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:41:11.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.907+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:41:11.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.919+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:41:11.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.949+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:41:11.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.949+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:41:11.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.955+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:41:11.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:11.987+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:41:12.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.004+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:41:12.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.014+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:41:12.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.044+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:41:12.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.063+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:41:12.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.067+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:41:12.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.069+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:41:12.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.107+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:41:12.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.112+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:41:12.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.127+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:41:12.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.157+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:41:12.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.162+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:41:12.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.168+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:41:12.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.174+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:41:12.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.210+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:41:12.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.220+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:41:12.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.234+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:41:12.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.241+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:41:12.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.246+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:41:12.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.255+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:41:12.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.276+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:12.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.289+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:41:12.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.290+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:41:12.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.329+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:41:12.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.336+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:41:12.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.343+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:41:12.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.349+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:41:12.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.368+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:41:12.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:41:12.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.388+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:41:12.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.401+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:41:12.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:12.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.428+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:41:12.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.454+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:41:12.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.465+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:41:12.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.468+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:41:12.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.484+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:12.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.486+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:41:12.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.491+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:41:12.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.492+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:41:12.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.512+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:41:12.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.525+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:41:12.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.555+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:41:12.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.565+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:41:12.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.572+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:41:12.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.610+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:41:12.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.621+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:41:12.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.624+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:41:12.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.637+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:41:12.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.647+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:12.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.652+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:41:12.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.667+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:41:12.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.671+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:41:12.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.689+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:41:12.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.692+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:41:12.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.705+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:41:12.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.711+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:41:12.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.723+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:41:12.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.737+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:41:12.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.746+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:41:12.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.754+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:41:12.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 289 16 3911907 3911891 845.919 851.938 0.000593013 0.0011714 2024-09-17T16:41:12.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.761+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:41:12.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.781+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3e4f7b:::benchmark_data_smithi165_34272_object3044:head, will try copies on 3,4 2024-09-17T16:41:12.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.812+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:41:12.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.818+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:41:12.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.829+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:41:12.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.836+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:41:12.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.837+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:41:12.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.871+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:41:12.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.886+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:41:12.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.888+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:41:12.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.913+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:41:12.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.937+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:41:12.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.938+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:41:12.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.950+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:41:12.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.977+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:41:12.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:12.994+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:41:13.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.001+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:13.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.003+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:41:13.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.007+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:13.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.017+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:41:13.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.026+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:41:13.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.034+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:41:13.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.046+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:41:13.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.046+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:41:13.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.065+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:41:13.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.177+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:41:13.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.184+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:13.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.199+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:41:13.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.207+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:41:13.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.209+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:41:13.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.215+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:41:13.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.228+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:41:13.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.240+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:13.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.245+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:41:13.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.280+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:41:13.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.282+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:41:13.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.288+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:41:13.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.310+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:41:13.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.311+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:41:13.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.312+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:41:13.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.321+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:41:13.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.321+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:41:13.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.336+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:41:13.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.376+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:41:13.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.378+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:41:13.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.379+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:41:13.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.379+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:41:13.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.397+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:41:13.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.402+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:41:13.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.417+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:41:13.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.429+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:41:13.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.465+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:41:13.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.465+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:41:13.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.496+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:41:13.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.497+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:41:13.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.497+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:41:13.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.506+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:41:13.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.507+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:41:13.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.518+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:41:13.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.547+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:41:13.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.561+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:41:13.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:13.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.568+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:41:13.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.584+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:41:13.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.603+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:13.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.609+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95a1dd2e:::benchmark_data_smithi165_34272_object4181:head, will try copies on 0,4 2024-09-17T16:41:13.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.610+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:41:13.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.613+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:41:13.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.626+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:41:13.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.652+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:41:13.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.653+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:41:13.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.660+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:41:13.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.664+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:41:13.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.674+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:41:13.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.700+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:13.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.707+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:41:13.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.716+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:41:13.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.731+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:41:13.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.752+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:41:13.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.756+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:41:13.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.760+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:41:13.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 290 16 3924381 3924365 845.691 779.625 0.000902662 0.00117172 2024-09-17T16:41:13.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.774+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:41:13.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.784+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:41:13.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.802+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:41:13.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.833+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:41:13.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.839+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:41:13.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.841+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:41:13.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.858+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b2a5398:::benchmark_data_smithi165_34272_object2482:head, will try copies on 0,4 2024-09-17T16:41:13.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.859+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:41:13.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.881+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:41:13.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.892+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:41:13.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.908+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:41:13.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.931+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:41:13.936 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.934+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:41:13.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.941+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:41:13.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.960+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:41:13.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.963+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:41:13.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.970+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:41:13.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:13.990+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:41:14.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.009+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:41:14.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.010+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:41:14.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.026+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:41:14.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.028+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:41:14.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.032+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:41:14.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.035+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:41:14.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.055+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:41:14.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.060+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:41:14.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.072+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:41:14.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.083+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:41:14.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.092+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:14.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.094+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:41:14.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.100+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:41:14.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.122+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:41:14.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.124+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:41:14.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.129+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:41:14.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.158+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:41:14.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.163+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:41:14.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.207+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:41:14.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.222+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:14.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.232+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:41:14.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.250+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:41:14.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.258+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:41:14.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.268+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:41:14.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.278+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:41:14.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.280+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:41:14.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.293+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:41:14.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.296+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:41:14.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.303+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:41:14.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.324+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:41:14.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.353+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:41:14.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.358+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:41:14.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.369+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:41:14.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.372+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:41:14.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.376+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:41:14.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.376+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:41:14.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.376+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:41:14.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.417+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:41:14.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.425+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:41:14.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.432+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:41:14.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.454+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:41:14.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.471+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:41:14.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.494+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:41:14.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.497+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:41:14.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.497+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:41:14.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.533+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:41:14.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.543+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:41:14.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.555+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:41:14.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.573+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:41:14.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.575+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:41:14.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.589+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:41:14.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.593+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:41:14.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.626+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:41:14.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.639+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:41:14.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.650+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:41:14.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:41:14.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.673+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:41:14.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.677+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:41:14.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.682+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:41:14.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.688+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:41:14.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.706+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:14.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.720+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:41:14.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.732+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:41:14.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.739+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:41:14.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.743+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:41:14.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.744+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:41:14.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 291 16 3938029 3938013 845.716 853 0.000797178 0.00117168 2024-09-17T16:41:14.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.767+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:41:14.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.767+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:41:14.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.793+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:41:14.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.799+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:41:14.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.813+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:41:14.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.819+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:41:14.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.824+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:41:14.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.841+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:41:14.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.841+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:41:14.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.863+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:41:14.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.891+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:41:14.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.893+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:41:14.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.894+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:953b72ee:::benchmark_data_smithi165_34272_object2788:head, will try copies on 0,4 2024-09-17T16:41:14.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.912+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:41:14.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.922+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:41:14.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.950+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:41:14.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.954+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:41:14.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.972+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:41:14.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:41:14.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.986+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:41:14.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:14.989+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:41:15.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.022+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:41:15.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.027+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:41:15.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.041+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:41:15.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.063+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:41:15.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.068+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dd7c342:::benchmark_data_smithi165_34272_object3571:head, will try copies on 0,4 2024-09-17T16:41:15.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.083+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:41:15.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.084+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:41:15.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.101+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:15.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.114+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:15.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.115+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:41:15.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.128+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:41:15.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.132+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:41:15.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.158+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:41:15.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.161+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:41:15.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.163+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:41:15.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:15.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.199+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:41:15.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.201+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:41:15.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.204+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:41:15.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.220+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:41:15.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.242+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:41:15.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.249+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:41:15.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.254+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:41:15.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.265+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:41:15.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:41:15.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.286+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:41:15.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.306+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:41:15.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.318+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:41:15.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.352+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:41:15.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.365+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:41:15.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.378+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:41:15.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.378+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:41:15.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.413+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:41:15.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.413+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:41:15.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.415+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:41:15.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.420+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:41:15.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.448+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:15.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.452+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:41:15.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.456+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:41:15.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.464+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:41:15.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.482+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:41:15.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.502+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99eb5a5c:::benchmark_data_smithi165_34272_object49:head, will try copies on 0,4 2024-09-17T16:41:15.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.522+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:41:15.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.528+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:41:15.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.533+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8d7a839:::benchmark_data_smithi165_34272_object2109:head, will try copies on 2,3 2024-09-17T16:41:15.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.542+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:41:15.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:41:15.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.603+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:41:15.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.612+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:41:15.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.613+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:41:15.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.642+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:41:15.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.646+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:41:15.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.667+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:15.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:41:15.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.697+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:41:15.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.705+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:41:15.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.734+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:15.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.752+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:15.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.755+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:41:15.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 292 15 3951975 3951960 845.804 871.688 0.000844411 0.00117156 2024-09-17T16:41:15.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.774+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:41:15.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.774+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:41:15.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.782+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:41:15.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.786+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:41:15.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.790+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:41:15.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.809+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:41:15.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.824+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:41:15.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.831+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:41:15.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.842+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:41:15.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.845+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e4feb2:::benchmark_data_smithi165_34272_object4259:head, will try copies on 0,4 2024-09-17T16:41:15.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.869+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:41:15.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.874+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:41:15.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.877+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:41:15.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.880+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:41:15.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.887+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:41:15.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.916+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:15.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.927+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:41:15.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.944+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:41:15.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.965+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:41:15.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.982+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:41:15.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:41:15.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.990+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:15.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.991+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:41:16.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:15.998+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:41:16.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.001+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:41:16.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.033+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:41:16.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.035+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:41:16.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.053+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:41:16.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.055+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:41:16.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.063+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:41:16.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.078+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:41:16.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.084+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:41:16.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.095+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:41:16.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.100+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:41:16.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.128+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:41:16.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.151+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:41:16.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.162+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:41:16.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.188+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:41:16.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.198+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22e7c20d:::benchmark_data_smithi165_34272_object3482:head, will try copies on 0,4 2024-09-17T16:41:16.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.200+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:41:16.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.210+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:41:16.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.224+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:41:16.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.234+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:41:16.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.243+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:41:16.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.252+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:41:16.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.270+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:41:16.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.280+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:41:16.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.282+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:41:16.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.290+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:41:16.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.291+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:41:16.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.326+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:41:16.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.346+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:41:16.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.361+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:16.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.379+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:41:16.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.393+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:41:16.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.393+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:41:16.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.408+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:41:16.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.423+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:41:16.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.440+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:41:16.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.444+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:41:16.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.451+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:41:16.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.463+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:41:16.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.487+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:41:16.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.500+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:41:16.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.502+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:41:16.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.505+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:41:16.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.511+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:41:16.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.528+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:41:16.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.531+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:41:16.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.535+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:41:16.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.536+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:41:16.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.537+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:41:16.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.554+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:41:16.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.583+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:41:16.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.588+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:41:16.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.601+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:41:16.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.615+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:41:16.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.627+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:16.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.640+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:41:16.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.653+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfee17b:::benchmark_data_smithi165_34272_object953:head, will try copies on 3,4 2024-09-17T16:41:16.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.665+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:41:16.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.675+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:41:16.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.684+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:41:16.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.687+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:41:16.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.692+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:41:16.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.696+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:41:16.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.724+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:41:16.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.740+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:41:16.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.758+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:41:16.763 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 293 15 3965507 3965492 845.804 845.75 0.00101217 0.00117156 2024-09-17T16:41:16.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.763+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:41:16.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.779+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:41:16.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.779+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:41:16.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.785+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:41:16.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.785+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:41:16.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.813+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:41:16.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.830+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:41:16.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.839+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:41:16.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.842+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:41:16.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.850+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:41:16.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.862+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:41:16.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.866+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:41:16.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.870+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:41:16.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.884+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:41:16.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.895+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:41:16.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.907+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:41:16.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.939+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:41:16.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.949+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:41:16.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.960+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:41:16.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.972+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:41:16.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.986+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:41:16.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:16.993+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:41:17.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.026+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:17.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.028+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:41:17.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.029+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:17.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.042+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:41:17.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.052+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:41:17.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.057+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:41:17.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.076+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:41:17.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:41:17.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.100+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:41:17.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.115+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:41:17.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.118+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:41:17.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.120+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:41:17.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.128+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:41:17.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.138+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:41:17.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.159+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:41:17.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.171+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:41:17.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.182+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:41:17.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.191+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:41:17.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.202+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:41:17.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.202+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:41:17.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.206+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:41:17.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.210+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:41:17.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.235+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:41:17.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.236+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:41:17.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.239+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d70ac0e:::benchmark_data_smithi165_34272_object4265:head, will try copies on 3,4 2024-09-17T16:41:17.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.275+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:41:17.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.307+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:17.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.315+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:41:17.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.326+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:41:17.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.328+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:41:17.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.338+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:41:17.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.360+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:41:17.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.375+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:41:17.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:41:17.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.388+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:41:17.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.395+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:17.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:41:17.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.409+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:41:17.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.442+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:41:17.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.452+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:41:17.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.459+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:41:17.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.465+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:41:17.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.475+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:41:17.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.484+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:41:17.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.504+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:41:17.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.521+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:41:17.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.523+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:41:17.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.545+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:41:17.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.547+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:41:17.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.554+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:41:17.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.566+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:41:17.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.568+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:41:17.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.582+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:41:17.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.625+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:17.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.632+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:41:17.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.654+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:41:17.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.667+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:41:17.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.673+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:41:17.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.682+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:41:17.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.699+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:41:17.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.701+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:41:17.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.716+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:41:17.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.730+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:41:17.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.731+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:41:17.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.735+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:41:17.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.749+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:41:17.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.754+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:41:17.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 294 16 3979352 3979336 845.87 865.25 0.000804159 0.00117146 2024-09-17T16:41:17.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.768+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:41:17.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.775+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff0ca9c:::benchmark_data_smithi165_34272_object4255:head, will try copies on 0,4 2024-09-17T16:41:17.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.788+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:41:17.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.805+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:41:17.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.816+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:41:17.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.832+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:41:17.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.838+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:41:17.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.850+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:41:17.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.858+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:41:17.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.882+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:41:17.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.882+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:41:17.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.918+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:41:17.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.943+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f845166:::benchmark_data_smithi165_34272_object3373:head, will try copies on 0,4 2024-09-17T16:41:17.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.954+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:17.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:17.975+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:41:18.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.011+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:41:18.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.013+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:41:18.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.018+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:41:18.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.026+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:41:18.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.031+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:41:18.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.056+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:41:18.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.060+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:41:18.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.072+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6436368f:::benchmark_data_smithi165_34272_object1511:head, will try copies on 3,4 2024-09-17T16:41:18.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.107+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:41:18.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.129+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:41:18.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.130+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:41:18.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.130+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:41:18.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.149+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:41:18.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.162+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:41:18.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.185+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:41:18.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.210+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:41:18.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.214+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:41:18.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.219+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:18.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.251+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:41:18.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.265+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:41:18.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.276+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:41:18.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.283+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a9a83e:::benchmark_data_smithi165_34272_object652:head, will try copies on 3,4 2024-09-17T16:41:18.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.283+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:41:18.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.292+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:41:18.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.329+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:18.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.329+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:41:18.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.333+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:41:18.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.346+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:41:18.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.351+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:41:18.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.355+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:41:18.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.376+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:41:18.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.408+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:41:18.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.423+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:18.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.425+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:41:18.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.442+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:41:18.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.444+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:41:18.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.444+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:18.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.446+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:18.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.462+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:41:18.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.496+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:41:18.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.497+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:41:18.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.503+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:41:18.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.505+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:41:18.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.518+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:41:18.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.523+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:41:18.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.526+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:41:18.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.546+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:18.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.560+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:41:18.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.573+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:18.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.582+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:41:18.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.588+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:41:18.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.589+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:41:18.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.605+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:41:18.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.608+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:41:18.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.651+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:41:18.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.654+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:41:18.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.676+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:41:18.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.691+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:41:18.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.693+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:41:18.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.693+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:41:18.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.703+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:41:18.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.735+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:41:18.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.739+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:41:18.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 295 15 3992971 3992956 845.888 851.25 0.000789345 0.00117144 2024-09-17T16:41:18.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.764+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:41:18.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.780+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:41:18.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.784+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:18.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.784+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:41:18.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.806+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:41:18.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.810+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:41:18.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.815+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:41:18.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.832+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:41:18.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.851+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:41:18.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.855+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:41:18.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.872+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:41:18.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.888+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:41:18.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.895+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:41:18.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.913+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:41:18.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.921+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:41:18.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.926+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:41:18.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.937+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:41:18.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.938+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:41:18.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.951+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:41:18.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.969+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:41:18.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.991+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:41:18.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.994+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:41:19.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:18.998+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:19.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.006+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:41:19.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.017+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:41:19.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.030+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:41:19.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.039+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:41:19.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.067+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:19.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.077+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:41:19.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.082+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:19.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.104+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:41:19.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.112+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:41:19.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.134+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:41:19.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.145+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:19.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.147+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:41:19.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.149+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:41:19.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.157+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:41:19.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.170+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:41:19.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.185+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:41:19.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.191+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:41:19.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.205+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:41:19.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.222+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:41:19.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.230+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:41:19.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.256+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:41:19.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.268+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:41:19.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.272+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:41:19.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.293+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:19.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.294+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:41:19.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.299+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:41:19.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.302+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:41:19.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.308+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:41:19.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.326+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:41:19.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.339+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:41:19.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.363+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:19.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.391+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:41:19.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.399+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:41:19.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.406+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:41:19.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.429+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:41:19.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.432+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:41:19.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.438+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:19.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.442+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:41:19.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:41:19.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.454+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:19.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.470+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:41:19.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.473+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:41:19.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.502+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:41:19.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.511+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:19.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.524+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:41:19.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.536+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:41:19.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.542+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:41:19.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.548+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:41:19.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.561+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:41:19.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.568+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:41:19.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.575+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:41:19.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.589+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:41:19.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.612+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:41:19.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.624+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:41:19.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.629+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:41:19.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.652+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:41:19.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.658+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:41:19.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.659+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:41:19.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.669+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:41:19.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.676+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:41:19.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.691+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:41:19.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.698+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:41:19.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.716+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:41:19.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.729+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:41:19.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:41:19.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.737+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:41:19.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.750+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:41:19.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.751+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:41:19.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.760+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:41:19.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 296 16 4006247 4006231 845.833 829.688 0.000790903 0.00117152 2024-09-17T16:41:19.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.782+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:41:19.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.783+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:41:19.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.784+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:41:19.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.796+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:41:19.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.798+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912b18b0:::benchmark_data_smithi165_34272_object3827:head, will try copies on 0,4 2024-09-17T16:41:19.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.828+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:41:19.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.838+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:41:19.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.846+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:19.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.847+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:41:19.875 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.873+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:41:19.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.882+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:41:19.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.897+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:41:19.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.912+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:41:19.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.919+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:41:19.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.955+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b48a9f7:::benchmark_data_smithi165_34272_object3582:head, will try copies on 0,4 2024-09-17T16:41:19.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.959+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:41:19.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.961+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:41:19.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.965+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:41:19.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.995+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:41:19.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:19.997+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:41:20.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.007+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:41:20.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.014+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:41:20.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.020+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:41:20.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.042+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:41:20.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.044+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b2590b4:::benchmark_data_smithi165_34272_object212:head, will try copies on 0,4 2024-09-17T16:41:20.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.051+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:41:20.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.080+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:41:20.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.083+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:41:20.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.084+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:41:20.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.102+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:41:20.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.117+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:41:20.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.118+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:41:20.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.142+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:41:20.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.146+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:41:20.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.160+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:41:20.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.173+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:20.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.195+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:41:20.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.198+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:41:20.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.205+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:41:20.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.227+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:41:20.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.232+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:41:20.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.234+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:20.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.242+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:41:20.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.255+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:41:20.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.275+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:41:20.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.279+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:41:20.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.284+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:20.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.292+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:41:20.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.300+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:41:20.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.322+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:41:20.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.343+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:41:20.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.343+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:41:20.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.352+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:41:20.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.368+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:41:20.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.369+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:41:20.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.375+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:41:20.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.384+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:41:20.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.397+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:41:20.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.402+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:41:20.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.439+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:41:20.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.448+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:20.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.449+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:41:20.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.456+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:41:20.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.459+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:41:20.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.466+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:41:20.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.474+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:41:20.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.510+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:41:20.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.510+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:41:20.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.520+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:41:20.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.532+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:41:20.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.535+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:41:20.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.549+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:41:20.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.550+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:41:20.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.558+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:41:20.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.594+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:41:20.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.609+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:41:20.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.610+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:41:20.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.624+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:41:20.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.646+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:41:20.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.658+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:20.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.667+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:41:20.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:41:20.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.668+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:41:20.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.677+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:41:20.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.686+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:41:20.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.695+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:41:20.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.704+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:41:20.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.709+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:20.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.722+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:41:20.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.735+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:41:20.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.752+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:41:20.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.758+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:41:20.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 297 16 4019611 4019595 845.797 835.25 0.00418689 0.00117156 2024-09-17T16:41:20.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.775+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:41:20.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.785+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:225d7ece:::benchmark_data_smithi165_34272_object3882:head, will try copies on 0,4 2024-09-17T16:41:20.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.798+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef86e5b:::benchmark_data_smithi165_34272_object1628:head, will try copies on 3,4 2024-09-17T16:41:20.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.832+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:41:20.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.845+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:20.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.865+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:41:20.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.884+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:41:20.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.886+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdab3b4d:::benchmark_data_smithi165_34272_object4203:head, will try copies on 2,3 2024-09-17T16:41:20.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.891+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:41:20.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.895+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:41:20.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.916+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:41:20.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.931+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:41:20.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.955+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:41:20.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.956+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:20.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.961+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:41:20.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:20.968+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:41:21.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.005+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:41:21.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.010+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:41:21.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.010+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:41:21.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a70b317:::benchmark_data_smithi165_34272_object1154:head, will try copies on 3,4 2024-09-17T16:41:21.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.051+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:41:21.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.068+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:41:21.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:21.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.078+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:41:21.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.096+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:41:21.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.105+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:41:21.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.128+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:41:21.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.144+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a5921a:::benchmark_data_smithi165_34272_object555:head, will try copies on 3,4 2024-09-17T16:41:21.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.147+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:41:21.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.152+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:41:21.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.169+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:41:21.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.189+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:41:21.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.196+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:41:21.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.200+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:41:21.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.232+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:41:21.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.237+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:41:21.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.246+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:41:21.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.258+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:41:21.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.260+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:21.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.261+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:41:21.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.284+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:21.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.285+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:41:21.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.306+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:41:21.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.318+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:41:21.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.331+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:41:21.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.340+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:41:21.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:41:21.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.401+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:41:21.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.411+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:41:21.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.419+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:41:21.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.440+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:41:21.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.450+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:41:21.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.467+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:41:21.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.490+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:41:21.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.491+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246418f4:::benchmark_data_smithi165_34272_object4409:head, will try copies on 0,4 2024-09-17T16:41:21.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.492+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:41:21.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.514+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:41:21.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.524+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:41:21.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.549+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:41:21.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.556+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:41:21.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.581+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:41:21.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.589+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:41:21.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.596+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:41:21.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.623+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:41:21.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.630+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:41:21.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.651+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb2bc82:::benchmark_data_smithi165_34272_object3269:head, will try copies on 3,4 2024-09-17T16:41:21.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.658+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:41:21.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.676+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:41:21.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.678+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:41:21.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.693+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:41:21.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.693+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:41:21.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.695+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:41:21.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.710+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:21.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.711+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:41:21.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.713+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:41:21.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.748+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:41:21.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 298 16 4033735 4033719 845.921 882.75 0.000982641 0.0011714 2024-09-17T16:41:21.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.778+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:41:21.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.791+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:41:21.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.795+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:41:21.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.797+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:41:21.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.819+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:41:21.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.826+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:41:21.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.841+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:41:21.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.846+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:41:21.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.860+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:41:21.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.861+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:41:21.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.872+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:41:21.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.876+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:41:21.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.905+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:41:21.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.910+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:41:21.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.912+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:41:21.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.915+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:41:21.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:41:21.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.973+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:41:21.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.988+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:41:21.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:21.992+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:41:22.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.002+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:41:22.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.002+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:41:22.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.026+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:41:22.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.053+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:41:22.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.077+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:41:22.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.085+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:41:22.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.089+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:41:22.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.117+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:41:22.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.138+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:41:22.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.143+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:41:22.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.143+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:41:22.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.155+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:41:22.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.167+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:41:22.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.167+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:41:22.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.177+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:41:22.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.197+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:22.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.211+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:41:22.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.224+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:41:22.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.226+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:41:22.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.228+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:41:22.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.232+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:41:22.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.245+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:41:22.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.249+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:41:22.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.274+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:41:22.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.296+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:41:22.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.303+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:41:22.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.307+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:41:22.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.323+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:41:22.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.325+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:22.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.331+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:41:22.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.348+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:41:22.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.371+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:41:22.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.397+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:41:22.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.414+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:41:22.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.416+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:41:22.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.434+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:41:22.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.463+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:41:22.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.474+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:41:22.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.486+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:41:22.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.489+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:22.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.499+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:41:22.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.522+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:41:22.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.523+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:22.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:41:22.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.532+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:41:22.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.536+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:41:22.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.553+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:41:22.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.564+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:41:22.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.581+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:41:22.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.584+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:41:22.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.594+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:41:22.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.614+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:41:22.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.629+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:41:22.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.633+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:41:22.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.646+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:41:22.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.658+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:41:22.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.671+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:41:22.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.692+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:41:22.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.700+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:22.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.704+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:41:22.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.710+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:41:22.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.724+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:41:22.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.742+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:41:22.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.743+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:41:22.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.747+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:41:22.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 299 16 4047447 4047431 845.957 857 0.000872929 0.00117134 2024-09-17T16:41:22.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.778+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:22.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.779+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:41:22.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.783+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:41:22.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.817+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:41:22.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.831+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:41:22.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.838+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:41:22.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.840+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:41:22.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.863+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:41:22.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.886+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:41:22.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.888+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:41:22.891 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.889+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:41:22.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:41:22.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.904+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:41:22.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.906+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:41:22.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.937+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:41:22.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.960+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:41:22.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.972+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:41:22.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.989+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:41:22.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:22.991+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:41:23.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.024+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:41:23.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.028+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:41:23.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.032+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:41:23.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.056+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:41:23.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.062+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:41:23.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.067+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:41:23.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.104+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:23.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.109+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:41:23.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.116+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:41:23.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.118+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:41:23.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.129+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:41:23.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.151+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:41:23.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.161+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:41:23.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.172+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:41:23.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.184+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:41:23.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.193+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:41:23.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.194+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:41:23.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.213+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:41:23.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.251+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:41:23.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.262+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:41:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.268+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:41:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.269+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:41:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.277+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:41:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.291+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:41:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.319+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:41:23.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.322+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:41:23.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.336+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:23.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.347+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:41:23.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.349+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:41:23.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.350+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:41:23.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.357+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:41:23.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.376+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:41:23.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.376+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:41:23.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.410+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:41:23.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.415+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:41:23.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.425+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:23.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.434+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:41:23.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.435+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:23.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.444+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:41:23.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.460+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:41:23.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.480+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:23.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.488+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:41:23.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.495+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:41:23.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.518+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:41:23.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.524+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:41:23.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.532+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:41:23.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.539+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:41:23.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.561+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:41:23.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.569+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:23.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.579+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:41:23.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.595+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:41:23.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.601+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:41:23.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.620+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:41:23.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.623+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:41:23.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.650+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:41:23.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.650+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:41:23.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.654+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:41:23.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.683+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:41:23.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.691+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:41:23.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.706+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:41:23.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.709+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:41:23.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.730+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:23.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.742+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf321ed:::benchmark_data_smithi165_34272_object718:head, will try copies on 2,3 2024-09-17T16:41:23.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.747+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:41:23.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.757+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:41:23.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:41:23.763256+0000 min lat: 0.000227768 max lat: 0.222415 avg lat: 0.00117114 2024-09-17T16:41:23.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:41:23.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 300 16 4061651 4061635 846.097 887.75 0.000580597 0.00117114 2024-09-17T16:41:23.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.765+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:41:23.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.793+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:41:23.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.809+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:41:23.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.809+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:41:23.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.824+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:41:23.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.842+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:41:23.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.845+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:41:23.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.899+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:41:23.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.905+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:41:23.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.906+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:41:23.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.911+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:41:23.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.916+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8858c:::benchmark_data_smithi165_34272_object873:head, will try copies on 2,3 2024-09-17T16:41:23.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.942+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:41:23.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.944+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:41:23.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.955+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:41:23.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.957+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:41:23.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.991+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:41:23.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.992+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:41:23.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:23.993+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:41:24.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.015+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:41:24.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.027+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:24.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.029+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:41:24.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.058+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:41:24.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.060+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:41:24.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.069+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:41:24.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.091+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:41:24.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.097+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:41:24.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.101+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:41:24.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.126+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:41:24.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.132+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:41:24.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:41:24.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.185+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:41:24.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.187+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:24.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.193+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:41:24.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.199+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:41:24.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.240+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:41:24.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.241+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:41:24.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.248+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:41:24.261 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.259+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:41:24.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.262+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:41:24.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.267+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:41:24.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.278+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:41:24.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.311+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:41:24.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.318+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:41:24.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.321+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:41:24.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.340+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:41:24.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.345+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:41:24.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.364+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:41:24.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.373+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:41:24.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.389+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:41:24.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.391+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:41:24.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.392+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aa0d3a:::benchmark_data_smithi165_34272_object2074:head, will try copies on 2,3 2024-09-17T16:41:24.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:41:24.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:41:24.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.421+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:41:24.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.459+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:41:24.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.466+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:41:24.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.473+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:41:24.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.511+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:41:24.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.523+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:41:24.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.525+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:41:24.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.536+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:24.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.550+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:41:24.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.560+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:41:24.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.567+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:41:24.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.592+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:41:24.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.596+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:41:24.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.606+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:41:24.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.607+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:41:24.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:41:24.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.624+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:41:24.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.625+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:41:24.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.636+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:41:24.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.644+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:24.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.656+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:41:24.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.682+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:41:24.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.692+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:41:24.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.706+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:41:24.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.718+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:41:24.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.728+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:41:24.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.735+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:41:24.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.738+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:41:24.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 301 16 4075569 4075553 846.175 869.875 0.000645895 0.00117104 2024-09-17T16:41:24.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.764+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:41:24.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.774+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:41:24.797 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.794+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:41:24.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.802+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:41:24.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.811+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:41:24.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.832+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:41:24.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.833+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:41:24.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.850+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:41:24.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.854+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:41:24.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.859+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:24.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.875+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:41:24.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.876+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:41:24.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.878+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:41:24.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.881+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:41:24.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.918+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:41:24.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:41:24.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.944+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:41:24.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.947+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:41:24.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:41:24.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.964+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:24.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.987+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:41:24.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.990+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:41:24.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:24.993+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:41:25.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.010+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:41:25.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.013+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:41:25.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.027+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:41:25.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.028+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:41:25.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.035+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:41:25.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.057+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:41:25.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.080+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:41:25.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.090+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:41:25.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.097+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:41:25.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.122+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:41:25.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.125+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:41:25.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.147+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:41:25.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.166+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b45a89:::benchmark_data_smithi165_34272_object819:head, will try copies on 0,4 2024-09-17T16:41:25.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.167+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:41:25.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.168+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:41:25.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.187+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:41:25.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.196+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:41:25.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:41:25.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.229+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6145b6ac:::benchmark_data_smithi165_34272_object4235:head, will try copies on 3,4 2024-09-17T16:41:25.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.235+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:41:25.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.244+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:41:25.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.253+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:41:25.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.267+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:41:25.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.297+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:41:25.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.304+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:41:25.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.331+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:41:25.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.351+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:41:25.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.356+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:41:25.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.359+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:25.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.367+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:41:25.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.399+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f5b28e:::benchmark_data_smithi165_34272_object815:head, will try copies on 0,4 2024-09-17T16:41:25.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:41:25.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.404+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:41:25.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.417+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:41:25.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.424+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:41:25.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.430+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:41:25.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.437+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:41:25.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.446+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:41:25.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.476+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:41:25.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.486+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:41:25.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.495+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:41:25.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.495+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:41:25.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.500+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:25.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.507+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:25.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.523+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:41:25.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.523+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:41:25.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.523+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:41:25.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.564+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:41:25.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.567+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:41:25.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.576+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:41:25.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.600+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:41:25.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.602+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:41:25.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.619+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:41:25.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.625+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:41:25.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.646+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:41:25.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.650+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:41:25.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.657+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:41:25.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.668+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:41:25.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.674+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:41:25.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.678+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:25.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.691+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:41:25.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.694+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:41:25.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:41:25.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.707+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:41:25.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 302 16 4088997 4088981 846.152 839.25 0.0010984 0.00117105 2024-09-17T16:41:25.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.766+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:41:25.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.774+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:41:25.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.775+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:41:25.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.792+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:41:25.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.798+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:41:25.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.802+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:41:25.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.823+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:41:25.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.826+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:25.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.828+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:41:25.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.842+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:41:25.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.856+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:41:25.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.866+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:41:25.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.881+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:41:25.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.882+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:41:25.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.890+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:41:25.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.917+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:25.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.922+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:41:25.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.922+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:41:25.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.946+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:41:25.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.953+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:41:25.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.976+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:41:25.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.988+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:41:25.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.991+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:41:25.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:25.991+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:41:26.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.000+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:41:26.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.021+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:41:26.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.042+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:26.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.064+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:41:26.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.074+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:41:26.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.075+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:41:26.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.086+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:41:26.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.111+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:41:26.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.127+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:26.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.151+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:41:26.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.159+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:26.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.165+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:26.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.176+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:41:26.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.177+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:41:26.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.207+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:41:26.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.209+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:41:26.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.241+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:41:26.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.242+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:41:26.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.260+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:41:26.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.260+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:41:26.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.269+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:41:26.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.278+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:41:26.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.279+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:41:26.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.294+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:41:26.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.302+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:41:26.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.311+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:41:26.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.315+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:41:26.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.320+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:41:26.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.343+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:41:26.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.367+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:41:26.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.379+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:41:26.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.381+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:26.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.394+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:41:26.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.397+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:41:26.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:41:26.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.405+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:41:26.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.433+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:41:26.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.447+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:41:26.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.467+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:41:26.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.474+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:41:26.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.481+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:41:26.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.490+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:41:26.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.504+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:41:26.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.529+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:41:26.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.540+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:26.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.549+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:41:26.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.567+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:41:26.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.570+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:41:26.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.572+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:41:26.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.575+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:41:26.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.580+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:41:26.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.582+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:41:26.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.612+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a8e6f21:::benchmark_data_smithi165_34272_object246:head, will try copies on 0,4 2024-09-17T16:41:26.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.625+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:26.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.626+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:41:26.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.666+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:41:26.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:41:26.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.685+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:41:26.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.698+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:41:26.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.700+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:41:26.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.719+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:41:26.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.724+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:41:26.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.729+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:41:26.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 303 15 4102827 4102812 846.212 864.438 0.00082187 0.00117099 2024-09-17T16:41:26.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.773+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:41:26.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.776+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:41:26.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.785+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:41:26.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.804+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:41:26.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.808+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:41:26.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.830+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:41:26.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.853+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:41:26.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.853+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:41:26.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.857+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:41:26.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.870+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:41:26.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.890+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:41:26.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.902+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:41:26.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.921+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:41:26.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.943+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:41:26.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.949+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:41:26.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.967+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:41:26.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.980+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:41:26.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.984+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:41:27.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:26.999+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:41:27.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.005+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:41:27.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.007+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67218b03:::benchmark_data_smithi165_34272_object2247:head, will try copies on 3,4 2024-09-17T16:41:27.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.009+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2abc5648:::benchmark_data_smithi165_34272_object693:head, will try copies on 0,4 2024-09-17T16:41:27.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:41:27.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.051+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:41:27.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.054+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:41:27.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.149+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:41:27.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.151+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:41:27.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.156+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:41:27.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.176+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:41:27.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.181+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:41:27.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.189+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:41:27.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.190+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:41:27.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.198+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95d1b48f:::benchmark_data_smithi165_34272_object3758:head, will try copies on 0,4 2024-09-17T16:41:27.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.232+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:41:27.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.240+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:41:27.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.241+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:41:27.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.267+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:41:27.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.269+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:41:27.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.300+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:41:27.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.316+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:41:27.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.324+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:41:27.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.328+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:41:27.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.334+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:41:27.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.343+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69095f2a:::benchmark_data_smithi165_34272_object2228:head, will try copies on 3,4 2024-09-17T16:41:27.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.343+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:41:27.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.356+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:41:27.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.380+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:41:27.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.380+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:41:27.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.398+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:41:27.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.412+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:41:27.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.442+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:41:27.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.448+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:41:27.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:41:27.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.474+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:41:27.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.476+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:41:27.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.486+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:41:27.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.494+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:41:27.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.513+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:41:27.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.527+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:41:27.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:41:27.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.538+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:41:27.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.547+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:41:27.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.551+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:27.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.585+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:41:27.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.593+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:41:27.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.604+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:27.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.606+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:41:27.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.620+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:41:27.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e0f929:::benchmark_data_smithi165_34272_object3621:head, will try copies on 3,4 2024-09-17T16:41:27.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.650+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:41:27.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.660+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:27.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.699+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:41:27.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.716+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:41:27.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.720+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:41:27.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.728+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9062a1c4:::benchmark_data_smithi165_34272_object3697:head, will try copies on 0,4 2024-09-17T16:41:27.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.732+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:41:27.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.745+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5039b6a3:::benchmark_data_smithi165_34272_object150:head, will try copies on 3,4 2024-09-17T16:41:27.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:41:27.764 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 304 15 4115599 4115584 846.054 798.25 0.000742935 0.00117121 2024-09-17T16:41:27.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.763+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:41:27.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.765+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:41:27.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.771+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:41:27.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.772+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:41:27.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.787+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:41:27.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.806+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:41:27.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.809+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:41:27.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.834+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:41:27.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.840+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:41:27.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.849+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:41:27.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.851+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21d816a0:::benchmark_data_smithi165_34272_object1951:head, will try copies on 0,4 2024-09-17T16:41:27.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.867+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:41:27.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.880+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:41:27.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.881+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:41:27.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.901+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:41:27.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.920+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:27.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.927+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:27.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.943+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:41:27.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.956+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:41:27.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.963+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:41:27.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.974+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:41:27.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:27.984+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:41:28.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.006+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:41:28.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.010+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:41:28.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.011+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:28.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.024+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:41:28.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.026+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:41:28.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.035+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:41:28.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.044+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:41:28.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:41:28.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.096+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:41:28.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.101+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:28.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.109+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:41:28.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.119+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:41:28.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.125+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:28.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.132+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:41:28.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.177+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:41:28.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.180+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:41:28.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.198+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:41:28.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.198+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:41:28.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.200+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:41:28.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.222+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:41:28.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.257+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:41:28.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.281+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:41:28.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.281+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:28.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.282+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:41:28.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.312+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:41:28.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.320+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:41:28.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.323+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:41:28.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.325+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:28.353 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.350+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:41:28.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.366+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:41:28.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.371+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ce5a22:::benchmark_data_smithi165_34272_object3608:head, will try copies on 3,4 2024-09-17T16:41:28.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.375+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:41:28.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.382+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:41:28.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.406+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:41:28.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.427+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:41:28.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.428+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:41:28.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.438+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29f25f32:::benchmark_data_smithi165_34272_object2594:head, will try copies on 0,4 2024-09-17T16:41:28.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.470+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:41:28.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.487+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:41:28.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.505+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:41:28.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.521+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:41:28.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.527+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:41:28.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.528+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:41:28.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.528+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:41:28.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.541+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:41:28.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.547+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:41:28.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.565+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:41:28.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.583+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:41:28.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.604+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:41:28.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.609+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:41:28.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.613+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b30400d5:::benchmark_data_smithi165_34272_object2442:head, will try copies on 2,3 2024-09-17T16:41:28.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.614+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:41:28.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6d53ab:::benchmark_data_smithi165_34272_object4477:head, will try copies on 3,4 2024-09-17T16:41:28.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.655+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:41:28.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.661+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:41:28.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.667+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:41:28.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.674+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:41:28.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.697+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:41:28.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.725+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:41:28.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.728+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:41:28.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.736+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:41:28.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 305 16 4129125 4129109 846.051 845.312 0.0010574 0.00117122 2024-09-17T16:41:28.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.784+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:41:28.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.798+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:41:28.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.799+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:41:28.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.806+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:41:28.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.815+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:41:28.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.843+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d25b29:::benchmark_data_smithi165_34272_object2077:head, will try copies on 2,3 2024-09-17T16:41:28.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.849+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:41:28.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.878+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:41:28.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.899+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:41:28.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.904+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:41:28.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.910+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:41:28.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.920+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:28.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.952+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:41:28.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.961+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:41:28.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.989+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:41:28.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.992+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:41:28.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:28.997+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:41:29.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.005+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:41:29.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.010+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:41:29.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.025+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:41:29.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.056+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:41:29.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.062+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:41:29.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.073+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:41:29.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.075+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:41:29.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:41:29.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.121+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:41:29.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.131+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:29.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.141+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b244e093:::benchmark_data_smithi165_34272_object3858:head, will try copies on 2,3 2024-09-17T16:41:29.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.164+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:29.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.166+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:41:29.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.194+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:41:29.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.199+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:41:29.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.202+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:41:29.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.214+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:41:29.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.220+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9da2cbc2:::benchmark_data_smithi165_34272_object1242:head, will try copies on 0,4 2024-09-17T16:41:29.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.224+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:41:29.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.237+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:41:29.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.238+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:41:29.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.255+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:41:29.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.270+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:41:29.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.312+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:41:29.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.332+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:41:29.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.359+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:41:29.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.369+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:41:29.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.383+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:41:29.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.397+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:41:29.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.405+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:41:29.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.417+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:41:29.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.423+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:41:29.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.428+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:41:29.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.432+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:41:29.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.444+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:41:29.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.469+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:29.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.479+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:29.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.488+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:41:29.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.491+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:41:29.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.497+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6006447b:::benchmark_data_smithi165_34272_object4237:head, will try copies on 3,4 2024-09-17T16:41:29.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.511+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:41:29.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.516+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:41:29.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.537+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:41:29.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.543+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:41:29.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.552+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:41:29.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.561+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:41:29.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.569+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:29.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.573+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:41:29.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.594+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:41:29.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.610+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:41:29.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.620+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:41:29.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.630+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:41:29.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.635+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:41:29.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.666+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:41:29.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.666+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:41:29.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.683+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:41:29.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.691+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:41:29.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.707+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:41:29.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.717+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:41:29.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.724+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:41:29.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.728+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:29.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.732+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:29.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.751+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:41:29.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 306 15 4142845 4142830 846.089 857.562 0.00126518 0.00117116 2024-09-17T16:41:29.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.770+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:41:29.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.773+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:41:29.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.778+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a1a89b1:::benchmark_data_smithi165_34272_object2886:head, will try copies on 3,4 2024-09-17T16:41:29.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.784+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:41:29.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.801+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:41:29.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.807+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:41:29.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.819+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:41:29.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.829+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:41:29.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.835+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:41:29.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.836+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:41:29.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.840+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:41:29.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.896+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:41:29.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.901+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:41:29.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.913+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:41:29.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.947+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:41:29.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.948+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:41:29.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.955+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:41:29.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.972+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:29.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.981+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:41:29.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:41:30.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:29.997+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:41:30.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.014+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:41:30.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.027+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:41:30.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.030+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:41:30.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.034+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc5dcfd:::benchmark_data_smithi165_34272_object1980:head, will try copies on 0,4 2024-09-17T16:41:30.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.050+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:41:30.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.072+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:41:30.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:41:30.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:41:30.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.153+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:41:30.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.154+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:41:30.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.156+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dbf9fee:::benchmark_data_smithi165_34272_object33:head, will try copies on 0,4 2024-09-17T16:41:30.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.199+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:41:30.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.204+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:41:30.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.212+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:30.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.235+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:41:30.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.235+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:41:30.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.253+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23397578:::benchmark_data_smithi165_34272_object2494:head, will try copies on 0,4 2024-09-17T16:41:30.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.267+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:41:30.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.269+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:41:30.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.272+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f9a2f:::benchmark_data_smithi165_34272_object3025:head, will try copies on 3,4 2024-09-17T16:41:30.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.284+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:41:30.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.300+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:30.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.326+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:41:30.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.339+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:41:30.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.342+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:41:30.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.344+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:41:30.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.367+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:41:30.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.370+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:41:30.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.381+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:41:30.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.387+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:30.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.411+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:41:30.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.420+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:41:30.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.426+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:41:30.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.459+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:41:30.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.469+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:41:30.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.474+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:41:30.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.478+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:41:30.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.488+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:41:30.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.497+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:30.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.523+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:41:30.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.524+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:41:30.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.541+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:41:30.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.551+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:41:30.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:41:30.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.592+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:41:30.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.594+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:41:30.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.618+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:41:30.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.623+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:41:30.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.646+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:41:30.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.647+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:30.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.662+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b5e3874:::benchmark_data_smithi165_34272_object1041:head, will try copies on 0,4 2024-09-17T16:41:30.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.662+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:41:30.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.666+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:41:30.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.701+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:41:30.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.719+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:41:30.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.721+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:41:30.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.727+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:41:30.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.729+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:41:30.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.734+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:30.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 307 16 4155996 4155980 846.009 821.875 0.000406663 0.00117121 2024-09-17T16:41:30.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.778+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:41:30.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.785+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:41:30.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.799+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:41:30.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.808+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:41:30.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.808+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:41:30.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.826+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:41:30.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.833+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:30.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.858+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:41:30.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.866+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:41:30.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:41:30.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.885+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:41:30.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.893+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:41:30.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.910+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:41:30.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.937+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:41:30.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.944+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:41:30.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.962+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:41:30.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.966+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:41:30.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.969+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:41:30.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.976+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:41:31.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:30.998+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:31.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.008+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:31.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.013+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:41:31.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.020+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:41:31.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.022+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:41:31.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.079+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:41:31.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.087+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:41:31.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.087+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:41:31.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.088+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:41:31.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.097+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:41:31.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.110+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:41:31.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.124+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:41:31.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:41:31.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.164+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:41:31.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.168+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:41:31.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.187+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:41:31.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.194+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:41:31.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.211+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:41:31.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.214+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:41:31.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.222+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:41:31.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.246+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:41:31.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.261+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:31.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.273+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:31.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.281+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:41:31.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.282+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:41:31.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.285+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:41:31.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.294+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:41:31.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.301+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:41:31.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.333+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90689de8:::benchmark_data_smithi165_34272_object74:head, will try copies on 0,4 2024-09-17T16:41:31.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.344+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:41:31.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.369+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:41:31.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.378+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:41:31.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.398+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:41:31.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.406+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:41:31.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.412+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:41:31.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.428+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:31.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.441+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:41:31.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.448+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:41:31.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.463+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:41:31.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.469+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:41:31.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.485+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:291c48b6:::benchmark_data_smithi165_34272_object1082:head, will try copies on 0,4 2024-09-17T16:41:31.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.491+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:41:31.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.496+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:41:31.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.501+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:41:31.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.530+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:41:31.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.533+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:41:31.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.534+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:41:31.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.579+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:41:31.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.586+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:41:31.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.589+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:41:31.597 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.594+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:41:31.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.605+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:41:31.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.614+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:41:31.628 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.624+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:41:31.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.632+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:41:31.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.664+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:41:31.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.672+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:41:31.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.675+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:41:31.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.679+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:41:31.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.689+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:41:31.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.706+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:41:31.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.716+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:41:31.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.734+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:41:31.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.742+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:41:31.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.753+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:41:31.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 308 16 4168827 4168811 845.866 801.938 0.000747784 0.00117147 2024-09-17T16:41:31.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.763+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:41:31.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.779+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:41:31.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.785+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:41:31.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.789+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:41:31.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.805+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:41:31.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.817+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:41:31.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.826+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:41:31.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.827+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:41:31.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.836+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:41:31.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.837+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:41:31.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.877+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:41:31.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.878+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:41:31.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.878+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:41:31.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.899+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:41:31.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.904+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:41:31.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.931+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:41:31.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.954+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:41:31.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.959+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:41:31.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.968+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:41:31.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:31.987+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:41:32.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.002+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc09991:::benchmark_data_smithi165_34272_object1098:head, will try copies on 0,4 2024-09-17T16:41:32.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.012+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:41:32.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.014+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:41:32.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.041+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:41:32.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.053+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:41:32.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.073+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:41:32.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.094+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:41:32.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.106+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:41:32.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.109+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:41:32.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.120+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:32.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.120+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:41:32.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.156+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:41:32.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.160+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:41:32.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.187+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:41:32.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.194+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:41:32.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:41:32.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.210+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:41:32.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.233+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:41:32.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.236+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:41:32.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.251+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:41:32.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.315+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:41:32.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.333+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:41:32.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.347+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:41:32.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.352+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:41:32.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.353+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:41:32.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.353+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:41:32.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.363+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:41:32.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.379+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd069b5:::benchmark_data_smithi165_34272_object300:head, will try copies on 3,4 2024-09-17T16:41:32.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.382+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:41:32.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.393+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:41:32.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.401+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:41:32.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.406+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:41:32.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.420+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:41:32.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.437+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:41:32.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.462+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:41:32.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.477+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:41:32.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.489+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:41:32.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.500+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:41:32.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.511+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:41:32.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.516+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:41:32.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.517+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:41:32.548 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.545+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:41:32.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.547+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:41:32.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.549+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:41:32.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.553+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:41:32.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.569+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:41:32.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.588+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:41:32.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.600+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:32.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.603+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:41:32.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.604+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:41:32.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.611+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:41:32.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:41:32.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.638+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:41:32.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.644+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f6e3981:::benchmark_data_smithi165_34272_object1541:head, will try copies on 0,4 2024-09-17T16:41:32.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.679+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:41:32.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.684+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:41:32.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.695+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:41:32.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.695+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:41:32.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.706+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:41:32.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.750+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:41:32.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.760+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:41:32.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 309 16 4181723 4181707 845.737 806 0.000441851 0.00117165 2024-09-17T16:41:32.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.763+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:41:32.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.791+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:41:32.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.802+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:41:32.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.814+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:41:32.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.828+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:41:32.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.836+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:41:32.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.844+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:41:32.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.860+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:41:32.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.863+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:32.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.871+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:41:32.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.884+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:41:32.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.904+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:41:32.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.921+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8f9595b:::benchmark_data_smithi165_34272_object347:head, will try copies on 2,3 2024-09-17T16:41:32.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.922+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:41:32.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.925+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:32.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.927+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:41:32.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.945+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:32.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.946+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:41:32.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.948+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:32.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.973+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:41:33.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:32.996+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:41:33.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.001+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:41:33.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.003+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:33.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:41:33.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.027+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:33.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:41:33.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.042+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:41:33.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.054+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:41:33.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.075+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:41:33.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.082+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:41:33.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.083+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:41:33.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.109+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:41:33.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.116+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:33.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.125+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:41:33.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.141+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:41:33.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.156+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:41:33.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.161+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:41:33.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.161+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:41:33.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.173+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:41:33.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.182+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:41:33.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.199+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:41:33.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.202+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:41:33.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.207+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:41:33.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.221+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:41:33.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.232+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:41:33.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:41:33.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.245+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:41:33.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.246+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:41:33.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.270+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:41:33.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.281+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:41:33.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.301+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:41:33.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.308+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:41:33.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.308+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:41:33.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.310+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:41:33.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.325+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:41:33.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.338+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:41:33.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.339+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:41:33.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.386+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:41:33.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.410+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd101ad1:::benchmark_data_smithi165_34272_object4424:head, will try copies on 2,3 2024-09-17T16:41:33.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.419+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:41:33.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.433+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:41:33.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.440+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:41:33.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.440+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:41:33.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.450+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:41:33.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.461+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb71de9c:::benchmark_data_smithi165_34272_object3728:head, will try copies on 2,3 2024-09-17T16:41:33.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.473+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:41:33.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.479+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:41:33.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.491+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:41:33.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.502+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:41:33.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.505+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:41:33.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.523+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:41:33.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.536+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:41:33.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.538+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:41:33.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.568+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:41:33.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.573+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:41:33.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.574+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:41:33.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.599+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:33.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.603+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:41:33.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.609+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:41:33.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.615+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:33.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.615+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:41:33.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.634+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:41:33.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.676+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:647c66ee:::benchmark_data_smithi165_34272_object32:head, will try copies on 3,4 2024-09-17T16:41:33.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.701+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:41:33.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.708+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:41:33.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.709+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:41:33.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.714+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:41:33.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.720+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:41:33.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.726+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:41:33.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.750+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bcdbb5:::benchmark_data_smithi165_34272_object382:head, will try copies on 3,4 2024-09-17T16:41:33.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.757+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:41:33.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 310 15 4195015 4195000 845.689 830.812 0.000681951 0.00117171 2024-09-17T16:41:33.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.763+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:41:33.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.765+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:41:33.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.769+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:41:33.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.797+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:41:33.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.813+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:41:33.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.813+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:41:33.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.819+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:41:33.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.832+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:41:33.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.843+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:41:33.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.856+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:41:33.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.875+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:33.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.882+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:41:33.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.914+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:41:33.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.914+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:41:33.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.921+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:41:33.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.940+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:41:33.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.948+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:41:33.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.964+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:41:33.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.965+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:33.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.987+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:41:33.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:33.996+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:41:34.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.011+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:41:34.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.027+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fcf66d:::benchmark_data_smithi165_34272_object3324:head, will try copies on 0,4 2024-09-17T16:41:34.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.041+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:41:34.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.042+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:41:34.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.044+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:41:34.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.050+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:41:34.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.053+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:41:34.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.061+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:41:34.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.063+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:41:34.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.076+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:41:34.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.088+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:41:34.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.121+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:41:34.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.136+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:41:34.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.158+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:41:34.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.160+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:34.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.163+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:41:34.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.169+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:41:34.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.191+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:41:34.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.199+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:41:34.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.210+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:41:34.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.250+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:41:34.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.265+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:41:34.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.272+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:41:34.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.283+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:41:34.290 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.287+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:41:34.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.300+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:41:34.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.319+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:41:34.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.323+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:41:34.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.338+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:41:34.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.348+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:41:34.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.359+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:34.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.375+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:41:34.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.386+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:41:34.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.390+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:41:34.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.393+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:41:34.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.394+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:41:34.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.421+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbbe085a:::benchmark_data_smithi165_34272_object1087:head, will try copies on 2,3 2024-09-17T16:41:34.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.423+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:41:34.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.428+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:41:34.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.442+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:41:34.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.459+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:41:34.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.461+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:41:34.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.485+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:41:34.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.501+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:41:34.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.505+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:41:34.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.526+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:41:34.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.541+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:41:34.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.543+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:41:34.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.546+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:41:34.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.556+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:41:34.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.562+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:34.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.563+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:41:34.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.580+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:41:34.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.581+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:41:34.608 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.604+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:34.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.621+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:41:34.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.621+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:41:34.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.630+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:41:34.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.639+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:34.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.640+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:41:34.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.669+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:41:34.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.678+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:41:34.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.682+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:34.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.691+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:34.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.693+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:41:34.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.714+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:41:34.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.717+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:41:34.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.725+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:41:34.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.750+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eedc368:::benchmark_data_smithi165_34272_object2122:head, will try copies on 0,4 2024-09-17T16:41:34.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.753+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:41:34.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.755+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:41:34.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.759+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:41:34.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 311 15 4208322 4208307 845.643 831.688 0.00378648 0.00117178 2024-09-17T16:41:34.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.788+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:41:34.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.808+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:41:34.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.808+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:41:34.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.842+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:41:34.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.847+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:41:34.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.871+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:41:34.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.877+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:41:34.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.881+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:41:34.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.905+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:41:34.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.913+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:41:34.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.930+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:41:34.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.954+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:41:34.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.955+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:41:34.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:34.989+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:41:35.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.003+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:41:35.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.023+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:41:35.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.038+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:41:35.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.045+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:41:35.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:41:35.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.079+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:41:35.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.094+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:41:35.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.096+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:41:35.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.100+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:41:35.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.117+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:41:35.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.121+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:41:35.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.138+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:41:35.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.143+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:41:35.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.170+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:41:35.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.174+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:35.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.185+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:41:35.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.192+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:41:35.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.230+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:41:35.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.231+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:41:35.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.237+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:41:35.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.238+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:41:35.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.252+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:580e34ea:::benchmark_data_smithi165_34272_object1274:head, will try copies on 3,4 2024-09-17T16:41:35.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.262+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:41:35.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.264+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:41:35.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.281+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:41:35.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.308+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:41:35.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.309+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:41:35.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.318+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:41:35.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.328+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:41:35.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.330+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:41:35.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.338+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:41:35.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.365+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:41:35.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.373+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:35.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.386+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:41:35.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.395+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:35.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.399+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:35.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.407+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:41:35.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.411+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9739e92d:::benchmark_data_smithi165_34272_object2873:head, will try copies on 0,4 2024-09-17T16:41:35.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.444+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:41:35.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.449+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:41:35.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.456+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:41:35.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.461+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:41:35.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.465+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:41:35.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.502+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:41:35.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.509+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:41:35.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.515+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bb0234:::benchmark_data_smithi165_34272_object2715:head, will try copies on 3,4 2024-09-17T16:41:35.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.522+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:41:35.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.524+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:41:35.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.530+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:41:35.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.571+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:41:35.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.585+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:41:35.596 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.594+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:41:35.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.629+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:41:35.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.635+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65a48c72:::benchmark_data_smithi165_34272_object1032:head, will try copies on 3,4 2024-09-17T16:41:35.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.644+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:41:35.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.653+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:41:35.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.664+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:41:35.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.665+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:41:35.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.672+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:41:35.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.684+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:41:35.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.688+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:41:35.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.695+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:41:35.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.719+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:41:35.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.739+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:41:35.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.759+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:41:35.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 312 15 4222366 4222351 845.746 877.75 0.000748347 0.00117164 2024-09-17T16:41:35.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.770+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:41:35.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.773+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:41:35.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.778+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:41:35.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.786+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:41:35.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.786+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213b8c8d:::benchmark_data_smithi165_34272_object2185:head, will try copies on 0,4 2024-09-17T16:41:35.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.809+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:41:35.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.814+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:41:35.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.827+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:41:35.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.859+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:41:35.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:41:35.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:41:35.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.881+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:41:35.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.893+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:41:35.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.912+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:41:35.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.924+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:41:35.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.926+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:41:35.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.932+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ae938c:::benchmark_data_smithi165_34272_object3643:head, will try copies on 0,4 2024-09-17T16:41:35.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.937+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c4b1f8:::benchmark_data_smithi165_34272_object3629:head, will try copies on 0,4 2024-09-17T16:41:35.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.946+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:41:35.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.956+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:41:35.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.982+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:41:35.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.995+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f2220ed:::benchmark_data_smithi165_34272_object903:head, will try copies on 0,4 2024-09-17T16:41:36.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:35.998+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:41:36.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.013+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:36.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.018+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:41:36.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.049+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d022dd2:::benchmark_data_smithi165_34272_object3646:head, will try copies on 3,4 2024-09-17T16:41:36.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.052+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:41:36.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.060+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:36.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.088+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:41:36.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.092+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:41:36.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.103+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:41:36.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.105+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:41:36.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.129+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:41:36.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.147+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:41:36.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:41:36.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.157+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:41:36.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.173+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:41:36.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.173+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:41:36.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.181+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:41:36.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.183+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:41:36.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.200+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:41:36.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.210+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:41:36.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.221+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:36.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.252+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:41:36.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.265+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:41:36.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.279+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:41:36.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.282+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:41:36.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.291+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502d9ab1:::benchmark_data_smithi165_34272_object2052:head, will try copies on 3,4 2024-09-17T16:41:36.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.310+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:41:36.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.320+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:41:36.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.339+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:41:36.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.341+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:41:36.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.349+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56fb0463:::benchmark_data_smithi165_34272_object199:head, will try copies on 3,4 2024-09-17T16:41:36.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.354+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:41:36.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.371+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:41:36.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.382+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:41:36.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.398+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:41:36.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.401+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:41:36.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.433+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:41:36.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.457+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:41:36.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.463+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:41:36.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.473+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:41:36.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.480+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:41:36.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.488+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:41:36.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.501+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:41:36.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.508+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:41:36.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.541+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:41:36.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.555+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:41:36.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.556+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:41:36.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.564+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:41:36.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.571+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:41:36.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.583+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:41:36.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.610+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:41:36.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.632+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:41:36.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.642+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:41:36.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.643+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:41:36.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.653+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:36.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.654+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:41:36.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.693+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:41:36.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.716+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:41:36.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.746+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:41:36.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.751+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:41:36.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.757+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:41:36.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.759+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:41:36.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 313 15 4236223 4236208 845.811 866.062 0.000822435 0.00117155 2024-09-17T16:41:36.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.776+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:41:36.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.787+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:41:36.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.788+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:41:36.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.789+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:41:36.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.830+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66ffd708:::benchmark_data_smithi165_34272_object1637:head, will try copies on 3,4 2024-09-17T16:41:36.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.831+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:41:36.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.850+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:41:36.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.863+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:41:36.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.894+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:41:36.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.900+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:41:36.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.903+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:41:36.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.908+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:41:36.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.912+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:41:36.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.937+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:41:36.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.944+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:41:36.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.948+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:41:36.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.956+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:41:36.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.969+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:41:36.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.970+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:41:36.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.993+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28474a9f:::benchmark_data_smithi165_34272_object3198:head, will try copies on 0,4 2024-09-17T16:41:36.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:36.993+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:41:37.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.011+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:37.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.019+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:37.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.037+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:41:37.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.037+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:41:37.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.050+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:41:37.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.051+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:41:37.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.053+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:37.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.060+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:41:37.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.079+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:41:37.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.095+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:41:37.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.102+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:41:37.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.113+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:41:37.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.134+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:41:37.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.146+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:41:37.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.178+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:41:37.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.180+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:920d76cc:::benchmark_data_smithi165_34272_object3777:head, will try copies on 0,4 2024-09-17T16:41:37.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.209+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:41:37.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.221+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:37.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.224+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:41:37.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.229+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:41:37.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.250+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:41:37.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.271+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:41:37.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.273+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:41:37.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.305+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd684231:::benchmark_data_smithi165_34272_object3925:head, will try copies on 2,3 2024-09-17T16:41:37.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.305+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50a48525:::benchmark_data_smithi165_34272_object18:head, will try copies on 3,4 2024-09-17T16:41:37.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.306+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:41:37.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.319+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:41:37.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.334+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:37.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.334+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:41:37.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.355+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:41:37.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:41:37.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.371+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:41:37.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.373+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:41:37.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.375+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:41:37.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.403+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:41:37.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.405+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:41:37.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.406+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:41:37.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.413+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:41:37.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.415+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:41:37.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.449+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:41:37.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.455+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:41:37.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.462+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:41:37.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.472+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:41:37.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.492+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:41:37.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.507+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:41:37.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.518+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:37.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.537+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:41:37.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.538+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:41:37.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.539+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:41:37.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.543+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:41:37.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.544+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:41:37.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.578+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:41:37.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.601+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:41:37.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.602+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c5698c3:::benchmark_data_smithi165_34272_object4068:head, will try copies on 3,4 2024-09-17T16:41:37.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.608+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:41:37.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.617+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:41:37.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.621+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:41:37.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.637+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:41:37.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:41:37.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.648+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:41:37.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.653+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:41:37.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.687+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:41:37.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.689+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:41:37.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.690+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:41:37.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.697+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:37.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.743+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:41:37.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.749+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:41:37.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.758+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:41:37.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.760+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:41:37.765 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 314 16 4249646 4249630 845.788 838.875 0.00097798 0.00117158 2024-09-17T16:41:37.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.771+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:37.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.785+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:41:37.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.787+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:41:37.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.789+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:41:37.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.806+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:41:37.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.820+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:41:37.851 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.849+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:41:37.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.855+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:41:37.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.857+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:41:37.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.860+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:41:37.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.875+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:41:37.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.885+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:41:37.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.907+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:41:37.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.913+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:41:37.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.914+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:41:37.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.930+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:41:37.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.932+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:41:37.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.953+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:41:37.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.961+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:41:37.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.997+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:41:38.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:37.998+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:41:38.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.012+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:41:38.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.014+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c81aa08:::benchmark_data_smithi165_34272_object667:head, will try copies on 0,4 2024-09-17T16:41:38.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.054+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:41:38.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.065+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:41:38.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.084+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:38.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.093+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:41:38.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.097+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:41:38.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.098+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:41:38.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.127+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:41:38.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.153+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:38.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.153+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:41:38.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.158+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ffcb62:::benchmark_data_smithi165_34272_object1931:head, will try copies on 3,4 2024-09-17T16:41:38.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.177+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:41:38.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.187+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:41:38.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.195+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:41:38.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:41:38.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.212+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:38.225 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.223+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:41:38.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.249+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:41:38.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.264+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:41:38.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.271+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:41:38.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.281+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:41:38.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.294+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:41:38.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.307+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:41:38.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.344+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:41:38.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.361+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:41:38.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.368+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:41:38.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.389+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:41:38.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.395+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:38.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.411+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ef908fc:::benchmark_data_smithi165_34272_object3630:head, will try copies on 3,4 2024-09-17T16:41:38.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.412+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:41:38.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.415+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:41:38.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.429+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ded1f72:::benchmark_data_smithi165_34272_object3615:head, will try copies on 3,4 2024-09-17T16:41:38.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.456+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:41:38.458 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.456+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:41:38.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.459+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:41:38.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.467+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:41:38.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.475+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:41:38.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.487+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:41:38.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.495+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:41:38.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.514+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:41:38.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.518+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:41:38.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.551+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:41:38.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.562+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:41:38.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.577+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:41:38.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:41:38.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.589+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:672506ea:::benchmark_data_smithi165_34272_object1934:head, will try copies on 3,4 2024-09-17T16:41:38.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.616+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:41:38.621 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.619+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:41:38.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.624+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:41:38.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.631+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:41:38.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.641+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:38.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:41:38.660 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.658+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:41:38.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.670+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:41:38.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.690+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:41:38.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.696+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:41:38.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.705+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:41:38.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.713+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:41:38.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.716+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:41:38.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.743+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:41:38.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.748+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:41:38.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 315 16 4263333 4263317 845.819 855.438 0.000659806 0.00117154 2024-09-17T16:41:38.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.767+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:38.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.773+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:41:38.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.792+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:41:38.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.810+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:41:38.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.817+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:41:38.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.823+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:41:38.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.828+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:41:38.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.850+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:41:38.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.856+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:41:38.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.860+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:41:38.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.882+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:41:38.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.886+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:41:38.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:41:38.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.905+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:41:38.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.912+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:41:38.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.921+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:41:38.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.922+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:41:38.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.937+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:41:38.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.959+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:41:38.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.963+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:41:38.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:38.967+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:41:39.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.004+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:41:39.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.009+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:41:39.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.016+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:41:39.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.042+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:41:39.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.055+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:41:39.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.076+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:41:39.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.085+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:41:39.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.096+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:41:39.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.107+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:41:39.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.116+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6267fc5a:::benchmark_data_smithi165_34272_object2578:head, will try copies on 3,4 2024-09-17T16:41:39.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.124+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:41:39.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.155+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:39.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.175+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:41:39.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.177+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:41:39.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.196+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:41:39.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.198+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:41:39.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.202+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:41:39.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.215+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:41:39.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.220+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:41:39.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.239+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:41:39.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.244+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:41:39.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.246+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:39.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.249+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:41:39.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.283+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:41:39.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.289+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2512f4af:::benchmark_data_smithi165_34272_object746:head, will try copies on 0,4 2024-09-17T16:41:39.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.327+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:41:39.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.342+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:41:39.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.349+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:41:39.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.365+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:41:39.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.365+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:41:39.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.369+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:41:39.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.387+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:41:39.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.404+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:41:39.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.411+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:41:39.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.421+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:41:39.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.422+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:41:39.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.433+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:41:39.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.438+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:41:39.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.463+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:41:39.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.466+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:41:39.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.488+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:41:39.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.507+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:41:39.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.509+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:646ce053:::benchmark_data_smithi165_34272_object4538:head, will try copies on 3,4 2024-09-17T16:41:39.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.515+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:41:39.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.517+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:41:39.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.532+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:41:39.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.536+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:41:39.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.553+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:41:39.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.554+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:41:39.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.564+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:41:39.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.579+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:41:39.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.590+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:41:39.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.593+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfae6377:::benchmark_data_smithi165_34272_object2198:head, will try copies on 2,3 2024-09-17T16:41:39.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.596+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:41:39.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.613+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:41:39.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.621+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:41:39.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.634+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:41:39.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.651+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6443db2:::benchmark_data_smithi165_34272_object2944:head, will try copies on 2,3 2024-09-17T16:41:39.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.663+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:41:39.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.663+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:41:39.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.688+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:41:39.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.694+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:41:39.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.697+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:41:39.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.703+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:39.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.703+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:41:39.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.705+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:41:39.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.733+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:41:39.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.745+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:41:39.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.749+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:41:39.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.762+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:41:39.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.762+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:41:39.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 316 16 4277103 4277087 845.865 860.625 0.000776092 0.00117147 2024-09-17T16:41:39.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.766+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:41:39.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.769+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:41:39.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.805+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:41:39.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.812+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:41:39.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.821+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:41:39.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.825+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6daa0734:::benchmark_data_smithi165_34272_object2735:head, will try copies on 3,4 2024-09-17T16:41:39.832 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.829+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:41:39.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.846+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:41:39.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.861+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:41:39.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:41:39.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.884+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:41:39.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.896+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:41:39.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.899+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:41:39.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.902+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:41:39.919 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.917+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:41:39.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.926+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:41:39.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.959+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:41:39.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.966+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7be1f83:::benchmark_data_smithi165_34272_object3059:head, will try copies on 2,3 2024-09-17T16:41:39.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.983+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:41:39.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:39.983+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:41:40.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.007+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54f22d3d:::benchmark_data_smithi165_34272_object4368:head, will try copies on 3,4 2024-09-17T16:41:40.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.032+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:41:40.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.032+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:40.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.062+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:41:40.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:41:40.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.072+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:40.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.080+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:41:40.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.081+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:41:40.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.094+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:41:40.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.112+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:41:40.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.125+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:41:40.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.127+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:41:40.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.129+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:41:40.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.139+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:41:40.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.159+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:41:40.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.170+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:40.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:41:40.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.182+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:41:40.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.186+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:41:40.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.200+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:41:40.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.216+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:41:40.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.224+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:41:40.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.230+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:41:40.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.251+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:41:40.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.257+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:40.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.271+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:41:40.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.281+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:41:40.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.281+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3df27ea:::benchmark_data_smithi165_34272_object2288:head, will try copies on 2,3 2024-09-17T16:41:40.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.300+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:41:40.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.306+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:41:40.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.318+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:41:40.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.333+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:41:40.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:41:40.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.345+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:41:40.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.346+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:41:40.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.360+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:41:40.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.380+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:41:40.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.384+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:41:40.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.386+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:41:40.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.414+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:41:40.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.430+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:41:40.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.431+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:41:40.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.431+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:41:40.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.433+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:41:40.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.458+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:41:40.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.468+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:41:40.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.493+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:41:40.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.495+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:41:40.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.503+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:41:40.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.557+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:41:40.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.559+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:41:40.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.563+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:40.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.576+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:41:40.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.587+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:41:40.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.591+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:41:40.604 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.602+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:41:40.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.610+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:40.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.616+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:41:40.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.628+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:41:40.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.642+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:41:40.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:41:40.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.675+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:40.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.677+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:41:40.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.677+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:41:40.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.682+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:41:40.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.707+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:41:40.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.723+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:40.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.730+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:41:40.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.736+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960d87a2:::benchmark_data_smithi165_34272_object3837:head, will try copies on 0,4 2024-09-17T16:41:40.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.757+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:41:40.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.760+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:41:40.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 317 15 4290401 4290386 845.819 831.188 0.00171596 0.00117154 2024-09-17T16:41:40.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.781+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:41:40.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.783+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:41:40.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.790+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:41:40.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.810+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:41:40.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.819+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:41:40.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.822+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:41:40.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.844+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:41:40.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.852+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54d8bcd9:::benchmark_data_smithi165_34272_object444:head, will try copies on 3,4 2024-09-17T16:41:40.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.876+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:41:40.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.922+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:41:40.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.928+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:41:40.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.949+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:41:40.974 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.971+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:41:40.987 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.984+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:41:41.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:40.998+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:41:41.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.003+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:41:41.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.031+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:41:41.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.039+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:41.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.046+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b05b09:::benchmark_data_smithi165_34272_object4494:head, will try copies on 2,3 2024-09-17T16:41:41.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.065+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:41:41.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.065+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:41:41.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.082+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:41:41.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.083+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:41:41.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.089+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:41:41.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.095+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:41:41.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.127+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:41:41.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.139+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db4b2a4:::benchmark_data_smithi165_34272_object13:head, will try copies on 0,4 2024-09-17T16:41:41.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.151+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7614574:::benchmark_data_smithi165_34272_object4525:head, will try copies on 2,3 2024-09-17T16:41:41.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.168+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:41:41.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.188+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:41:41.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.211+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:41:41.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.215+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:41:41.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.216+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:41:41.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.216+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:41:41.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.242+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:41:41.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.244+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:41:41.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.261+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:41:41.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.262+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:41:41.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.282+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:41.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.287+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:41:41.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.294+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:41:41.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.304+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:41:41.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.339+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:41:41.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.348+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:41:41.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.371+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:41:41.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.373+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:41:41.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.378+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:41:41.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.390+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:41:41.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.402+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:41:41.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.408+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:41:41.416 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.414+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:41:41.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.448+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:41:41.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.476+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:41:41.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.480+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:41:41.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.481+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:41:41.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.496+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:41:41.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.497+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:41:41.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.511+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:41:41.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.525+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:41.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.532+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:41:41.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.533+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:41.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.533+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:41:41.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.565+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:41.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.595+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:41.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.597+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:41:41.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.598+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:41:41.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.601+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:41:41.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.615+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:41:41.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.635+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:41:41.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.640+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:41:41.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.645+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:41:41.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.659+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:41:41.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.671+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd675366:::benchmark_data_smithi165_34272_object390:head, will try copies on 2,3 2024-09-17T16:41:41.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.682+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:41:41.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.697+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:41.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.718+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:41:41.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.735+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:41:41.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.738+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:41.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.739+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:41:41.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.745+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:41:41.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.759+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6356b7:::benchmark_data_smithi165_34272_object1719:head, will try copies on 0,4 2024-09-17T16:41:41.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 318 16 4304435 4304419 845.917 877.062 0.000987886 0.00117139 2024-09-17T16:41:41.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.804+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:41:41.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.805+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:41:41.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.809+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:41:41.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.835+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9912440a:::benchmark_data_smithi165_34272_object2781:head, will try copies on 0,4 2024-09-17T16:41:41.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.835+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:41:41.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.836+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:41:41.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.839+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:41.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.853+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eccf9f2:::benchmark_data_smithi165_34272_object1963:head, will try copies on 0,4 2024-09-17T16:41:41.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.862+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:41:41.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.874+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:41:41.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:628ae03c:::benchmark_data_smithi165_34272_object1858:head, will try copies on 3,4 2024-09-17T16:41:41.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.915+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:41:41.928 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.926+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:41.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.929+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:41:41.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.948+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:41.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.953+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:41:41.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.956+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:41:41.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.976+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:41:41.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.991+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:41:41.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.993+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:41:41.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:41.997+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:41:42.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.014+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:41:42.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.019+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:41:42.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.037+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:41:42.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:41:42.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.052+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:41:42.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.052+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:41:42.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.060+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:41:42.064 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.062+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:41:42.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.090+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fa7b365:::benchmark_data_smithi165_34272_object993:head, will try copies on 0,4 2024-09-17T16:41:42.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.096+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:41:42.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.119+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:41:42.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.127+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:41:42.135 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.132+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:41:42.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.193+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:41:42.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.202+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:41:42.208 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.206+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:41:42.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.208+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:41:42.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.220+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:41:42.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.253+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:41:42.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.270+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:41:42.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.273+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:41:42.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.279+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:41:42.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.280+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb646cb7:::benchmark_data_smithi165_34272_object2282:head, will try copies on 2,3 2024-09-17T16:41:42.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.294+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:41:42.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.317+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:41:42.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.324+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:41:42.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.330+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:41:42.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.345+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:41:42.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.353+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:41:42.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.359+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:42.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.375+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:41:42.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.378+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:41:42.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.393+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:41:42.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.409+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:41:42.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.412+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:41:42.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.427+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28d25c56:::benchmark_data_smithi165_34272_object2487:head, will try copies on 0,4 2024-09-17T16:41:42.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.429+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:41:42.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.430+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:41:42.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.468+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:41:42.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.489+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:41:42.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.491+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dcc9a83:::benchmark_data_smithi165_34272_object1523:head, will try copies on 0,4 2024-09-17T16:41:42.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.511+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:41:42.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.512+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:41:42.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.521+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:41:42.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.536+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:41:42.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.537+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:41:42.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.540+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:41:42.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.558+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:41:42.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.578+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:41:42.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.583+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a22254b:::benchmark_data_smithi165_34272_object4117:head, will try copies on 3,4 2024-09-17T16:41:42.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.597+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:41:42.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.604+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:41:42.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.610+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:41:42.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.612+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:41:42.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.620+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:974d02e7:::benchmark_data_smithi165_34272_object281:head, will try copies on 0,4 2024-09-17T16:41:42.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.643+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:41:42.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.645+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bec0f6b:::benchmark_data_smithi165_34272_object1619:head, will try copies on 3,4 2024-09-17T16:41:42.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.649+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:41:42.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.670+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:41:42.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.683+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:41:42.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.690+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:41:42.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.702+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:582c6063:::benchmark_data_smithi165_34272_object51:head, will try copies on 3,4 2024-09-17T16:41:42.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.706+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:41:42.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.726+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6219569a:::benchmark_data_smithi165_34272_object108:head, will try copies on 3,4 2024-09-17T16:41:42.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.728+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:41:42.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.737+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:41:42.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 319 16 4317226 4317210 845.771 799.438 0.00130525 0.00117161 2024-09-17T16:41:42.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.771+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:41:42.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.772+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:42.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.780+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93df0c65:::benchmark_data_smithi165_34272_object1197:head, will try copies on 0,4 2024-09-17T16:41:42.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.793+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc658134:::benchmark_data_smithi165_34272_object3246:head, will try copies on 2,3 2024-09-17T16:41:42.820 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.818+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326ceaf:::benchmark_data_smithi165_34272_object2497:head, will try copies on 0,4 2024-09-17T16:41:42.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.819+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:41:42.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.848+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:41:42.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.864+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:41:42.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.883+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:41:42.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.891+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:41:42.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.900+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:41:42.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.905+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:41:42.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.926+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:41:42.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.927+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:41:42.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.954+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b2ac885:::benchmark_data_smithi165_34272_object4112:head, will try copies on 3,4 2024-09-17T16:41:42.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.955+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:41:42.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.973+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:41:42.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.983+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:41:42.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.987+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:41:42.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.989+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:41:42.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:42.990+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:41:43.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.007+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:41:43.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.019+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:41:43.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.030+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:41:43.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.037+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:41:43.048 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.046+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:41:43.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.070+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:41:43.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.083+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:41:43.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.100+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:41:43.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.107+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:41:43.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.128+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2883015e:::benchmark_data_smithi165_34272_object2855:head, will try copies on 0,4 2024-09-17T16:41:43.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.130+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:41:43.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.132+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:41:43.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:43.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.163+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:41:43.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.175+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:41:43.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.191+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:43.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.200+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:41:43.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.220+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:41:43.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.221+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:41:43.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.226+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:41:43.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.241+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:41:43.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.243+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:41:43.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.251+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:41:43.254 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.251+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:41:43.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.274+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:41:43.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.280+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:41:43.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.310+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:41:43.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.312+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:41:43.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.339+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:41:43.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.340+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:41:43.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.343+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:41:43.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.357+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:41:43.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.375+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:41:43.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.384+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:41:43.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.385+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:41:43.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.387+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:41:43.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.406+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:41:43.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.409+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:41:43.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.419+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:41:43.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.441+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:41:43.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.445+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:41:43.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.463+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:41:43.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.496+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:41:43.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.501+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:41:43.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.504+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:41:43.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.526+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:41:43.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.535+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:41:43.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.538+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20aebd00:::benchmark_data_smithi165_34272_object3336:head, will try copies on 0,4 2024-09-17T16:41:43.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.541+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:41:43.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.545+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:41:43.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.550+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655af8cc:::benchmark_data_smithi165_34272_object272:head, will try copies on 3,4 2024-09-17T16:41:43.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.587+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:43.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.596+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:41:43.599 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.597+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ad7f8ba:::benchmark_data_smithi165_34272_object3207:head, will try copies on 3,4 2024-09-17T16:41:43.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.607+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ebc7f80:::benchmark_data_smithi165_34272_object823:head, will try copies on 0,4 2024-09-17T16:41:43.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.610+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:41:43.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.650+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:41:43.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.668+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b32b3831:::benchmark_data_smithi165_34272_object1198:head, will try copies on 2,3 2024-09-17T16:41:43.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.672+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:41:43.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.678+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:41:43.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.707+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:41:43.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.707+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:43.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.713+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:41:43.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.719+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:41:43.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.738+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:41:43.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:41:43.765108+0000 min lat: 0.000227768 max lat: 0.222415 avg lat: 0.0011716 2024-09-17T16:41:43.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:41:43.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 320 16 4330787 4330771 845.776 847.562 0.010437 0.0011716 2024-09-17T16:41:43.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.771+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:41:43.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.775+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:41:43.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.783+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:41:43.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.791+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:41:43.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.793+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc9d2:::benchmark_data_smithi165_34272_object1030:head, will try copies on 3,4 2024-09-17T16:41:43.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.803+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d2662d6:::benchmark_data_smithi165_34272_object1317:head, will try copies on 0,4 2024-09-17T16:41:43.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.809+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:41:43.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.829+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:41:43.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.844+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:41:43.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.850+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:41:43.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.859+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:41:43.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.875+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:41:43.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.876+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:43.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.884+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:41:43.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.896+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:41:43.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.907+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:41:43.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.919+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:41:43.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.943+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:41:43.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.958+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:41:43.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.971+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:41:43.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.976+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:41:43.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.985+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:41:43.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:43.994+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:627e5d60:::benchmark_data_smithi165_34272_object252:head, will try copies on 3,4 2024-09-17T16:41:44.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.004+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:41:44.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.014+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:41:44.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.033+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:41:44.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.048+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:41:44.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.052+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:41:44.059 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.057+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:44.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.069+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:41:44.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.072+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f797f4e:::benchmark_data_smithi165_34272_object3915:head, will try copies on 0,4 2024-09-17T16:41:44.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.075+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:41:44.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.083+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:41:44.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.087+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:41:44.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.098+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:44.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.111+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:41:44.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.146+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:41:44.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.149+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:41:44.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.157+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:41:44.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.161+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:44.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.173+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:41:44.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.181+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:41:44.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.209+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:41:44.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.216+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:44.219 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.217+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:41:44.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.229+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:41:44.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.247+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:41:44.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.255+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:41:44.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.274+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:41:44.277 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.274+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:41:44.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.293+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:41:44.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.330+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:41:44.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.335+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:44.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.352+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:41:44.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.352+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:41:44.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.357+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:41:44.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.368+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:41:44.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.374+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:41:44.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.394+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:41:44.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.402+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:41:44.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.410+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93edad28:::benchmark_data_smithi165_34272_object2859:head, will try copies on 0,4 2024-09-17T16:41:44.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.432+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:41:44.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.434+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:41:44.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.444+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:41:44.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.444+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:41:44.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.476+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:44.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.486+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:41:44.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.493+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:44.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.515+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b9491c:::benchmark_data_smithi165_34272_object3610:head, will try copies on 3,4 2024-09-17T16:41:44.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.520+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:44.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.530+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:41:44.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.548+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:41:44.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.565+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:41:44.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.566+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:41:44.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.571+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:44.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.584+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:41:44.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.585+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:41:44.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.592+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:41:44.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.622+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:41:44.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.628+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:41:44.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.636+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:41:44.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.658+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:41:44.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.662+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:41:44.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.662+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:41:44.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.691+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:41:44.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.693+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:41:44.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.698+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:41:44.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.708+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:41:44.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.724+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:41:44.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.739+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:41:44.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.744+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:41:44.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.744+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f3d819c:::benchmark_data_smithi165_34272_object760:head, will try copies on 0,4 2024-09-17T16:41:44.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.753+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:41:44.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.761+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:41:44.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 321 16 4344296 4344280 845.771 844.312 0.000719708 0.00117159 2024-09-17T16:41:44.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.797+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:41:44.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.799+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:41:44.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.816+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f7aebb:::benchmark_data_smithi165_34272_object3363:head, will try copies on 0,4 2024-09-17T16:41:44.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.827+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:41:44.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.841+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:41:44.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.854+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:41:44.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.862+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:41:44.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.869+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:41:44.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.877+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:41:44.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.881+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:41:44.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.894+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:41:44.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.900+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:41:44.904 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.902+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:41:44.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.935+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:41:44.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.938+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:41:44.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.944+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50e9a411:::benchmark_data_smithi165_34272_object1883:head, will try copies on 3,4 2024-09-17T16:41:44.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.956+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:41:44.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.981+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:41:44.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:44.986+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:41:45.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.010+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:41:45.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.027+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:41:45.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.027+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:41:45.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.031+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:41:45.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.047+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:41:45.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.051+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:41:45.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.059+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:45.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.078+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:41:45.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.081+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:594b9d35:::benchmark_data_smithi165_34272_object4419:head, will try copies on 3,4 2024-09-17T16:41:45.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.083+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:41:45.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.086+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:41:45.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.088+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5f7c7a4:::benchmark_data_smithi165_34272_object1386:head, will try copies on 2,3 2024-09-17T16:41:45.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.126+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:41:45.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.144+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:41:45.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.146+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:41:45.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.150+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:41:45.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.155+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:41:45.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.173+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:41:45.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.193+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:41:45.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.198+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:41:45.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.198+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:41:45.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:41:45.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.230+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:41:45.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.271+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:41:45.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.277+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:41:45.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:41:45.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.289+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:41:45.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.319+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:41:45.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.322+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:41:45.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.328+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:41:45.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.337+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:41:45.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.340+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:41:45.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.345+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:41:45.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.346+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:45.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.354+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3ef22f:::benchmark_data_smithi165_34272_object2131:head, will try copies on 3,4 2024-09-17T16:41:45.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.374+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:41:45.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.410+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:41:45.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.416+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:41:45.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.433+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:41:45.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.437+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff8d675:::benchmark_data_smithi165_34272_object2617:head, will try copies on 3,4 2024-09-17T16:41:45.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.437+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:41:45.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.452+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:45.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.461+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:41:45.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.481+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:41:45.500 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.498+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:41:45.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.506+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:41:45.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.525+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:41:45.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.528+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:41:45.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.533+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:41:45.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.541+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:41:45.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:41:45.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.569+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:41:45.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.574+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:41:45.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.579+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:41:45.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.603+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b61d5c24:::benchmark_data_smithi165_34272_object3083:head, will try copies on 2,3 2024-09-17T16:41:45.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.616+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:41:45.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.624+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:635cee92:::benchmark_data_smithi165_34272_object1725:head, will try copies on 3,4 2024-09-17T16:41:45.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.635+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:41:45.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.637+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:41:45.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.647+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:41:45.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:41:45.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.674+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:41:45.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.690+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b09385:::benchmark_data_smithi165_34272_object1414:head, will try copies on 3,4 2024-09-17T16:41:45.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.697+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:41:45.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.702+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:41:45.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.703+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:41:45.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.730+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:41:45.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.738+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:41:45.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 322 16 4357880 4357864 845.781 849 0.000585669 0.00117158 2024-09-17T16:41:45.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.767+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:41:45.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.780+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:41:45.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.783+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f7da14:::benchmark_data_smithi165_34272_object2851:head, will try copies on 2,3 2024-09-17T16:41:45.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.793+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:41:45.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.796+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:41:45.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.801+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:41:45.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.819+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:41:45.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.831+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:41:45.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.845+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:41:45.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.846+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:41:45.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.851+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:41:45.872 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.870+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:41:45.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.874+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:41:45.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.898+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:41:45.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.898+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:41:45.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.903+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:41:45.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.924+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:41:45.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.963+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:41:45.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.964+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6169b6cb:::benchmark_data_smithi165_34272_object4332:head, will try copies on 3,4 2024-09-17T16:41:45.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.970+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93ce7829:::benchmark_data_smithi165_34272_object1111:head, will try copies on 0,4 2024-09-17T16:41:45.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.982+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:41:46.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:45.998+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:41:46.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.005+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:41:46.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.015+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:41:46.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.016+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:41:46.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.021+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:41:46.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.056+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:41:46.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.067+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:41:46.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.069+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6db1e618:::benchmark_data_smithi165_34272_object2225:head, will try copies on 3,4 2024-09-17T16:41:46.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.073+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23e12bd3:::benchmark_data_smithi165_34272_object3890:head, will try copies on 0,4 2024-09-17T16:41:46.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.088+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:41:46.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:41:46.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.102+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:41:46.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.128+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:41:46.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.146+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:41:46.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.167+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:41:46.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.168+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:41:46.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.182+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:41:46.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.204+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:41:46.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.219+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:41:46.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.221+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:41:46.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.228+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:41:46.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.235+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:46.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.256+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:41:46.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.263+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5231da62:::benchmark_data_smithi165_34272_object2348:head, will try copies on 3,4 2024-09-17T16:41:46.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.279+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:41:46.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.285+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:41:46.311 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.309+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:41:46.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.331+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:41:46.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.348+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:41:46.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.352+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:41:46.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.364+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:41:46.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.368+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:41:46.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.373+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:41:46.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.375+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:41:46.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.400+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:41:46.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.412+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:41:46.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.415+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:41:46.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.426+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:41:46.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.433+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:46.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.459+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52b432b9:::benchmark_data_smithi165_34272_object4428:head, will try copies on 3,4 2024-09-17T16:41:46.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.470+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:41:46.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.477+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:41:46.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.480+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:46.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.484+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:41:46.516 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.513+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:41:46.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.534+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:41:46.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.536+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:41:46.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.537+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:46.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.542+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:41:46.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.555+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:41:46.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.561+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:910eb4d1:::benchmark_data_smithi165_34272_object4175:head, will try copies on 0,4 2024-09-17T16:41:46.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.580+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:41:46.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.587+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:41:46.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.607+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:41:46.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.614+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e9039e:::benchmark_data_smithi165_34272_object2197:head, will try copies on 0,4 2024-09-17T16:41:46.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.618+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:46.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.625+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:41:46.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.632+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:41:46.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.646+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:41:46.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.661+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:46.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.678+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:41:46.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.682+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:41:46.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.684+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:41:46.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.709+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:41:46.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.711+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:41:46.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.736+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:41:46.740 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.738+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:41:46.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.757+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:41:46.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.758+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:41:46.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 323 15 4371503 4371488 845.799 851.5 0.00119158 0.00117157 2024-09-17T16:41:46.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.775+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:41:46.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.775+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b3a9eb8:::benchmark_data_smithi165_34272_object2514:head, will try copies on 3,4 2024-09-17T16:41:46.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.794+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:41:46.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.812+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:41:46.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.814+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:41:46.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.826+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:41:46.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.837+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:41:46.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.860+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:41:46.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.864+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:41:46.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.872+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:41:46.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.876+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:41:46.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.888+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:41:46.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.908+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:41:46.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.913+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:41:46.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.915+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:41:46.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.933+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:41:46.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.941+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:41:46.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.954+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:41:46.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.961+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:41:46.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.975+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:41:46.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:46.994+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:41:47.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.001+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:47.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.013+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:41:47.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.026+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:47.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.030+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:41:47.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.032+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:41:47.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.054+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:41:47.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.076+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:41:47.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.083+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:569bf9e9:::benchmark_data_smithi165_34272_object2298:head, will try copies on 3,4 2024-09-17T16:41:47.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.087+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:47.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.093+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:41:47.117 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.114+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:41:47.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.118+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:41:47.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.128+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:41:47.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.138+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:41:47.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.156+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:41:47.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.171+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:41:47.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.173+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:41:47.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.195+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:41:47.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.205+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e9d30bc:::benchmark_data_smithi165_34272_object4453:head, will try copies on 3,4 2024-09-17T16:41:47.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.207+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:41:47.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.211+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:47.242 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.240+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:41:47.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.258+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:41:47.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.260+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:41:47.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.266+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:41:47.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.297+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:47.326 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.324+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:41:47.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.334+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:47.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.335+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:41:47.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.349+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:41:47.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.352+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:41:47.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.384+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:47.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.385+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:41:47.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.387+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe145c:::benchmark_data_smithi165_34272_object3040:head, will try copies on 0,4 2024-09-17T16:41:47.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:47.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.401+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:41:47.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.434+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:41:47.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.438+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:41:47.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.472+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:41:47.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.479+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:41:47.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.486+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:41:47.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.492+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:41:47.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.502+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:41:47.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.522+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:41:47.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.530+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:41:47.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.560+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:41:47.566 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.564+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:41:47.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.578+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:41:47.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.591+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:41:47.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.608+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:682ed98b:::benchmark_data_smithi165_34272_object1809:head, will try copies on 3,4 2024-09-17T16:41:47.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.614+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:41:47.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.621+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:41:47.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.636+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:41:47.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.640+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:41:47.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.642+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:41:47.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.650+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7cd98f:::benchmark_data_smithi165_34272_object1610:head, will try copies on 2,3 2024-09-17T16:41:47.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.653+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6997c41e:::benchmark_data_smithi165_34272_object3617:head, will try copies on 3,4 2024-09-17T16:41:47.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.674+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:41:47.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.688+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:41:47.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.700+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98c03176:::benchmark_data_smithi165_34272_object945:head, will try copies on 0,4 2024-09-17T16:41:47.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.702+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:41:47.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.717+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:41:47.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.718+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:41:47.722 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.720+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:41:47.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.729+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e7b2715:::benchmark_data_smithi165_34272_object81:head, will try copies on 0,4 2024-09-17T16:41:47.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.757+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:41:47.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.763+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:41:47.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 324 16 4384890 4384874 845.77 836.625 0.00147969 0.0011716 2024-09-17T16:41:47.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.768+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:41:47.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.783+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:41:47.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.784+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:41:47.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.805+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:41:47.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.807+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:41:47.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.826+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:41:47.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.842+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:41:47.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.853+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:41:47.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.885+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:41:47.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.894+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:41:47.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.920+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:41:47.924 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.922+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:41:47.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.933+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1a11bc:::benchmark_data_smithi165_34272_object3531:head, will try copies on 3,4 2024-09-17T16:41:47.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.947+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:41:47.951 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.948+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:41:47.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.958+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:41:47.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.969+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:41:47.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.977+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:41:47.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.983+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:41:47.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:47.990+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:41:48.005 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.003+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:41:48.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.013+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:41:48.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.019+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:41:48.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.032+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:41:48.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.043+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:41:48.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:41:48.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.081+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:48.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.096+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:41:48.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.097+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:41:48.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.109+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:41:48.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.116+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a716695:::benchmark_data_smithi165_34272_object4550:head, will try copies on 0,4 2024-09-17T16:41:48.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.137+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:41:48.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.148+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:48.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.171+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:41:48.188 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.186+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:41:48.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:41:48.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.202+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:41:48.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.210+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:41:48.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.224+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:41:48.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96e3390a:::benchmark_data_smithi165_34272_object2935:head, will try copies on 0,4 2024-09-17T16:41:48.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.256+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:41:48.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.260+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:41:48.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.265+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:48.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284ad2d7:::benchmark_data_smithi165_34272_object1303:head, will try copies on 0,4 2024-09-17T16:41:48.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.298+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:41:48.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.314+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc39e1b2:::benchmark_data_smithi165_34272_object4018:head, will try copies on 2,3 2024-09-17T16:41:48.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.322+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:41:48.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.375+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:41:48.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.376+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:41:48.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.384+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:41:48.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.404+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686eef6f:::benchmark_data_smithi165_34272_object35:head, will try copies on 3,4 2024-09-17T16:41:48.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.405+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:41:48.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.422+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e8791:::benchmark_data_smithi165_34272_object3919:head, will try copies on 3,4 2024-09-17T16:41:48.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.426+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:41:48.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.459+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:41:48.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.480+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:41:48.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.483+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:41:48.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.486+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:41:48.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.495+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:41:48.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.517+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5888deb3:::benchmark_data_smithi165_34272_object2590:head, will try copies on 3,4 2024-09-17T16:41:48.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.526+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:41:48.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.528+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:41:48.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.551+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:48.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.560+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:41:48.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.576+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:41:48.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.589+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:41:48.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:41:48.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.621+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:41:48.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.625+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:41:48.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.627+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:41:48.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.647+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:41:48.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.660+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:41:48.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.667+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:41:48.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.674+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:41:48.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.679+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:41:48.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.685+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:41:48.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.694+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:41:48.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.718+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:41:48.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.722+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:41:48.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.733+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:41:48.750 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.748+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:41:48.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.761+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:41:48.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 325 16 4398375 4398359 845.761 842.812 0.000657305 0.00117162 2024-09-17T16:41:48.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.788+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:41:48.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.801+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2c9ab48:::benchmark_data_smithi165_34272_object4144:head, will try copies on 2,3 2024-09-17T16:41:48.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.805+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:41:48.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.829+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:41:48.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.846+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d4e9c7:::benchmark_data_smithi165_34272_object2753:head, will try copies on 3,4 2024-09-17T16:41:48.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.858+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:41:48.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.863+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:41:48.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.865+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:41:48.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.873+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:41:48.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.878+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fea28f:::benchmark_data_smithi165_34272_object3791:head, will try copies on 0,4 2024-09-17T16:41:48.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.901+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:41:48.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.903+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:41:48.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.912+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629e2dd1:::benchmark_data_smithi165_34272_object1644:head, will try copies on 3,4 2024-09-17T16:41:48.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.936+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54ab0c71:::benchmark_data_smithi165_34272_object2013:head, will try copies on 3,4 2024-09-17T16:41:48.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.947+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93843879:::benchmark_data_smithi165_34272_object2507:head, will try copies on 0,4 2024-09-17T16:41:48.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.960+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:41:48.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.977+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:48.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.978+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cffdd8:::benchmark_data_smithi165_34272_object2821:head, will try copies on 0,4 2024-09-17T16:41:48.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:48.986+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69bd66f9:::benchmark_data_smithi165_34272_object2644:head, will try copies on 3,4 2024-09-17T16:41:49.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.008+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:41:49.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.021+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:41:49.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.022+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:41:49.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.029+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:41:49.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.031+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:41:49.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.074+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:41:49.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.095+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:41:49.104 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.102+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:41:49.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.109+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:41:49.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.113+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:41:49.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.119+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:41:49.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.142+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:41:49.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.155+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:41:49.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.165+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:41:49.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.174+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:41:49.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.182+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:41:49.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.201+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:49.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.211+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:41:49.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.238+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:41:49.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.238+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:41:49.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.283+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:41:49.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.284+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:41:49.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.287+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:41:49.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.296+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:41:49.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.308+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:41:49.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.326+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:41:49.336 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.334+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:41:49.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.341+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:41:49.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.371+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:41:49.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.372+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:41:49.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.377+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:41:49.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.401+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:41:49.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.407+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:41:49.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.421+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:49.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.427+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:41:49.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:41:49.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.472+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:41:49.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.477+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:41:49.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.479+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:41:49.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.495+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:41:49.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.514+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:41:49.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.524+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:41:49.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.552+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:41:49.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.572+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a3283f:::benchmark_data_smithi165_34272_object3626:head, will try copies on 0,4 2024-09-17T16:41:49.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.575+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:41:49.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.598+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ab4c6a6:::benchmark_data_smithi165_34272_object3369:head, will try copies on 3,4 2024-09-17T16:41:49.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.600+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:41:49.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.601+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6167a0f0:::benchmark_data_smithi165_34272_object3943:head, will try copies on 3,4 2024-09-17T16:41:49.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.611+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:41:49.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.641+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:41:49.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.644+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:41:49.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.646+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:41:49.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.661+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:41:49.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.668+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:41:49.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.676+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:41:49.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.685+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:41:49.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.694+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:41:49.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.711+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62cd5cfe:::benchmark_data_smithi165_34272_object167:head, will try copies on 3,4 2024-09-17T16:41:49.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.714+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:41:49.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.730+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:41:49.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.731+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:41:49.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.748+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:41:49.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 326 15 4412327 4412312 845.841 872.062 0.000716349 0.0011715 2024-09-17T16:41:49.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.776+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68bce4a1:::benchmark_data_smithi165_34272_object1156:head, will try copies on 3,4 2024-09-17T16:41:49.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.778+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:41:49.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.784+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:41:49.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.786+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:41:49.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.794+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:41:49.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.814+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:41:49.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.814+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:49.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.843+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:41:49.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.846+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:49.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.865+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:41:49.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.892+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:49.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.893+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:41:49.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.896+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:41:49.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.901+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:41:49.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.926+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:41:49.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.935+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:41:49.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.955+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:41:49.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.961+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:41:49.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.967+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:41:49.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.977+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:41:49.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.982+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:41:49.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:49.997+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:41:50.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.008+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:41:50.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.027+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52065650:::benchmark_data_smithi165_34272_object1590:head, will try copies on 3,4 2024-09-17T16:41:50.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.043+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9001e1c4:::benchmark_data_smithi165_34272_object2696:head, will try copies on 0,4 2024-09-17T16:41:50.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.054+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:41:50.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.061+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:41:50.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.064+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:41:50.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.071+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:41:50.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.072+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:41:50.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.087+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:41:50.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.089+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:41:50.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:41:50.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.131+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:41:50.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.136+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:41:50.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.143+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:41:50.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.149+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ed9a746:::benchmark_data_smithi165_34272_object3809:head, will try copies on 3,4 2024-09-17T16:41:50.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.170+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:41:50.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.180+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:41:50.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.230+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:41:50.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.240+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:41:50.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.244+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e7d7017:::benchmark_data_smithi165_34272_object2854:head, will try copies on 3,4 2024-09-17T16:41:50.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.247+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:41:50.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.278+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:41:50.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.285+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:41:50.299 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.297+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:41:50.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.301+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:41:50.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.328+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:41:50.348 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.345+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:41:50.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.354+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:41:50.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.364+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:50.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.365+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5803c399:::benchmark_data_smithi165_34272_object2290:head, will try copies on 3,4 2024-09-17T16:41:50.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.374+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:41:50.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.384+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:41:50.386 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.384+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:41:50.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.392+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55ed0497:::benchmark_data_smithi165_34272_object4430:head, will try copies on 3,4 2024-09-17T16:41:50.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.419+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:41:50.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.433+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:41:50.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.442+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:41:50.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.457+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:41:50.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.461+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:41:50.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.468+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9894bbaa:::benchmark_data_smithi165_34272_object4217:head, will try copies on 0,4 2024-09-17T16:41:50.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.499+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f5f2e72:::benchmark_data_smithi165_34272_object2813:head, will try copies on 3,4 2024-09-17T16:41:50.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.500+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:41:50.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.519+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:41:50.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.535+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:41:50.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.537+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:41:50.545 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.543+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:41:50.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.558+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:41:50.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.563+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:41:50.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.584+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:41:50.590 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.588+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:41:50.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.601+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:50.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af7c53c:::benchmark_data_smithi165_34272_object1237:head, will try copies on 3,4 2024-09-17T16:41:50.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.615+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f6b09f6:::benchmark_data_smithi165_34272_object4082:head, will try copies on 0,4 2024-09-17T16:41:50.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.634+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:41:50.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.654+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:41:50.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.659+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:41:50.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.660+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:41:50.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.679+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:41:50.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.685+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:41:50.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.705+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:41:50.708 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.705+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fed510f:::benchmark_data_smithi165_34272_object4283:head, will try copies on 0,4 2024-09-17T16:41:50.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.707+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:41:50.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.709+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:41:50.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.739+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:50.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.752+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:41:50.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 327 15 4426036 4426021 845.875 856.812 0.000523888 0.00117146 2024-09-17T16:41:50.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.797+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:41:50.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.808+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e8b730:::benchmark_data_smithi165_34272_object4035:head, will try copies on 2,3 2024-09-17T16:41:50.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.809+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:41:50.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.824+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:41:50.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.827+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:41:50.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.839+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b83460d:::benchmark_data_smithi165_34272_object3149:head, will try copies on 0,4 2024-09-17T16:41:50.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.841+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:41:50.858 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.856+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a189931:::benchmark_data_smithi165_34272_object4210:head, will try copies on 0,4 2024-09-17T16:41:50.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.862+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:41:50.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.886+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:41:50.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.894+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:41:50.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.903+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:41:50.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.930+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:41:50.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.940+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:41:50.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.944+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:41:50.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.954+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:41:50.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.968+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fa2684e:::benchmark_data_smithi165_34272_object1435:head, will try copies on 0,4 2024-09-17T16:41:50.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.973+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f8d8d82:::benchmark_data_smithi165_34272_object1861:head, will try copies on 0,4 2024-09-17T16:41:50.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.988+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b26e8d6:::benchmark_data_smithi165_34272_object3994:head, will try copies on 3,4 2024-09-17T16:41:50.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:50.997+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:51.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.001+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:41:51.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.033+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:41:51.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.050+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:41:51.069 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.067+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:41:51.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.071+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:41:51.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.085+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:41:51.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.085+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65781f86:::benchmark_data_smithi165_34272_object2246:head, will try copies on 3,4 2024-09-17T16:41:51.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.107+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fe4cb03:::benchmark_data_smithi165_34272_object1037:head, will try copies on 3,4 2024-09-17T16:41:51.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.126+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:41:51.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.127+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:51.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.143+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:41:51.172 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.170+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:41:51.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.178+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:41:51.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.183+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:41:51.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.192+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7c87d6e:::benchmark_data_smithi165_34272_object1926:head, will try copies on 2,3 2024-09-17T16:41:51.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.199+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:41:51.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:41:51.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.249+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:41:51.257 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.255+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:41:51.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.257+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fc97c9:::benchmark_data_smithi165_34272_object4441:head, will try copies on 3,4 2024-09-17T16:41:51.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.271+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:41:51.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.280+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:41:51.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.296+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8e675b:::benchmark_data_smithi165_34272_object1151:head, will try copies on 3,4 2024-09-17T16:41:51.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.311+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:51.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.325+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:41:51.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.330+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:41:51.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:41:51.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.349+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:41:51.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.368+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:41:51.374 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.372+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:41:51.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.379+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:41:51.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.391+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:41:51.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.396+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:41:51.424 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.422+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d47b320:::benchmark_data_smithi165_34272_object1958:head, will try copies on 3,4 2024-09-17T16:41:51.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.426+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4ba4a2:::benchmark_data_smithi165_34272_object2910:head, will try copies on 0,4 2024-09-17T16:41:51.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.440+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:41:51.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.446+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:41:51.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.466+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:41:51.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.467+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3d5c1c:::benchmark_data_smithi165_34272_object3041:head, will try copies on 3,4 2024-09-17T16:41:51.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.468+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:41:51.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.500+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265fa982:::benchmark_data_smithi165_34272_object2911:head, will try copies on 0,4 2024-09-17T16:41:51.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.508+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:41:51.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.517+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:41:51.532 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.529+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:41:51.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.536+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:41:51.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.538+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:41:51.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.544+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:41:51.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:41:51.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.564+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:41:51.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.584+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bebf7ecf:::benchmark_data_smithi165_34272_object1036:head, will try copies on 2,3 2024-09-17T16:41:51.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.596+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:41:51.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.606+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:41:51.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.616+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:51.619 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.616+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:41:51.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.640+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:41:51.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.654+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:51.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:41:51.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.667+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6846a997:::benchmark_data_smithi165_34272_object1788:head, will try copies on 3,4 2024-09-17T16:41:51.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.676+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aaa91bb:::benchmark_data_smithi165_34272_object1228:head, will try copies on 3,4 2024-09-17T16:41:51.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.679+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:41:51.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.681+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:41:51.701 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.698+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:41:51.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.714+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:41:51.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.734+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:41:51.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.737+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:41:51.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.737+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:51.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.740+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55467e51:::benchmark_data_smithi165_34272_object2465:head, will try copies on 3,4 2024-09-17T16:41:51.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.756+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:41:51.766 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 328 16 4439571 4439555 845.875 845.875 0.000638006 0.00117146 2024-09-17T16:41:51.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.772+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:41:51.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.780+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:41:51.784 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.782+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:41:51.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.797+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:41:51.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.809+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:41:51.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.823+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:41:51.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.823+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:41:51.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.838+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6214eaf0:::benchmark_data_smithi165_34272_object887:head, will try copies on 3,4 2024-09-17T16:41:51.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.839+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c4d025a:::benchmark_data_smithi165_34272_object854:head, will try copies on 0,4 2024-09-17T16:41:51.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.843+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:41:51.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.852+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:41:51.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.885+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:41:51.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.895+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:41:51.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.899+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:41:51.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.900+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad0c162:::benchmark_data_smithi165_34272_object654:head, will try copies on 0,4 2024-09-17T16:41:51.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.927+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:41:51.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.941+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6444ea0e:::benchmark_data_smithi165_34272_object4266:head, will try copies on 3,4 2024-09-17T16:41:51.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.951+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:41:51.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.964+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:41:51.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.969+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:41:51.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.978+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:41:51.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:51.979+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:41:52.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.009+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:41:52.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.016+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:41:52.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.037+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:41:52.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.041+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:41:52.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.048+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9aa21ce:::benchmark_data_smithi165_34272_object3766:head, will try copies on 2,3 2024-09-17T16:41:52.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.073+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:41:52.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.080+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:41:52.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.087+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:41:52.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.095+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:41:52.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.105+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21ecf0e9:::benchmark_data_smithi165_34272_object3063:head, will try copies on 0,4 2024-09-17T16:41:52.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.107+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:41:52.111 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.109+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:41:52.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.124+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:41:52.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:52.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.175+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40b1a1c:::benchmark_data_smithi165_34272_object117:head, will try copies on 2,3 2024-09-17T16:41:52.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.185+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:41:52.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.185+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f5288e4:::benchmark_data_smithi165_34272_object1115:head, will try copies on 0,4 2024-09-17T16:41:52.193 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.191+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:41:52.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.207+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:202d9828:::benchmark_data_smithi165_34272_object68:head, will try copies on 0,4 2024-09-17T16:41:52.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.211+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:41:52.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.228+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:41:52.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.231+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:41:52.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.234+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:41:52.269 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.267+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:41:52.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.269+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:41:52.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.276+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:41:52.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.285+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f95ffc6:::benchmark_data_smithi165_34272_object1210:head, will try copies on 3,4 2024-09-17T16:41:52.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.329+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:41:52.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.331+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:41:52.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.340+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:41:52.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.342+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b5cba1:::benchmark_data_smithi165_34272_object2068:head, will try copies on 0,4 2024-09-17T16:41:52.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.354+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:41:52.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.364+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:41:52.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.376+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:41:52.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.386+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:270ae3f0:::benchmark_data_smithi165_34272_object611:head, will try copies on 0,4 2024-09-17T16:41:52.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.399+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:41:52.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.399+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:41:52.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.427+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:41:52.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.434+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b50b57ff:::benchmark_data_smithi165_34272_object1367:head, will try copies on 2,3 2024-09-17T16:41:52.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.435+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:41:52.438 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.436+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:41:52.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.452+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:41:52.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.465+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:41:52.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.468+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:41:52.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.482+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:41:52.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.488+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:41:52.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.515+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:41:52.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.523+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:41:52.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.531+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644cfbec:::benchmark_data_smithi165_34272_object617:head, will try copies on 3,4 2024-09-17T16:41:52.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:41:52.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.550+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:41:52.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.562+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:41:52.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.562+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:41:52.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.598+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:41:52.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.607+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:41:52.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.610+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:41:52.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.612+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:41:52.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.625+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:41:52.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.655+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:41:52.667 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.665+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5456ea2e:::benchmark_data_smithi165_34272_object1250:head, will try copies on 3,4 2024-09-17T16:41:52.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.682+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:41:52.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.691+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:41:52.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.695+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:41:52.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.722+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:235afe66:::benchmark_data_smithi165_34272_object2709:head, will try copies on 0,4 2024-09-17T16:41:52.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.725+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:41:52.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.735+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:41:52.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.745+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9478dc60:::benchmark_data_smithi165_34272_object341:head, will try copies on 0,4 2024-09-17T16:41:52.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.758+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5009025:::benchmark_data_smithi165_34272_object1664:head, will try copies on 2,3 2024-09-17T16:41:52.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 329 16 4452946 4452930 845.844 835.938 0.000735755 0.0011715 2024-09-17T16:41:52.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.775+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:41:52.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.784+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd8542b6:::benchmark_data_smithi165_34272_object1669:head, will try copies on 2,3 2024-09-17T16:41:52.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.786+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:41:52.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.799+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:41:52.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.799+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:41:52.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.816+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:41:52.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.822+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:41:52.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.840+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f2356f8:::benchmark_data_smithi165_34272_object3181:head, will try copies on 3,4 2024-09-17T16:41:52.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.841+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:41:52.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.858+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:41:52.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.865+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5aae0ee2:::benchmark_data_smithi165_34272_object2726:head, will try copies on 3,4 2024-09-17T16:41:52.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.879+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:52.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.902+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:41:52.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.914+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:41:52.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.919+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:41:52.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.930+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:41:52.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.940+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:41:52.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.951+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:41:52.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.980+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:41:52.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:52.986+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:41:53.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.006+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:41:53.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.007+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:41:53.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.011+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:587d9a0a:::benchmark_data_smithi165_34272_object1255:head, will try copies on 3,4 2024-09-17T16:41:53.026 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.024+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:41:53.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.033+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:53.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.041+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e98bb5:::benchmark_data_smithi165_34272_object55:head, will try copies on 2,3 2024-09-17T16:41:53.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.058+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:41:53.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.080+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:41:53.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.081+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:41:53.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.093+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:41:53.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.094+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:41:53.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.102+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:41:53.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.125+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:41:53.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.138+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:41:53.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.152+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:41:53.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.173+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:41:53.181 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.179+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:41:53.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.192+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:41:53.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.199+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63bacab8:::benchmark_data_smithi165_34272_object431:head, will try copies on 3,4 2024-09-17T16:41:53.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.220+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdfe6956:::benchmark_data_smithi165_34272_object2486:head, will try copies on 2,3 2024-09-17T16:41:53.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.229+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:41:53.238 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.235+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:41:53.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.274+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29db849a:::benchmark_data_smithi165_34272_object2541:head, will try copies on 0,4 2024-09-17T16:41:53.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.282+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:41:53.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.294+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:41:53.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.311+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:41:53.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.319+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:41:53.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.322+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:41:53.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.339+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:41:53.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.344+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:41:53.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.358+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:41:53.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.379+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:41:53.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.380+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:41:53.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.395+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:41:53.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.399+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:41:53.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.402+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:41:53.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.416+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:41:53.430 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.428+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:41:53.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.442+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:41:53.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.459+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:41:53.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.465+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50be3637:::benchmark_data_smithi165_34272_object3169:head, will try copies on 3,4 2024-09-17T16:41:53.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.467+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:41:53.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.480+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:41:53.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.495+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bd0e94b:::benchmark_data_smithi165_34272_object2277:head, will try copies on 3,4 2024-09-17T16:41:53.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.495+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:41:53.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.513+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:53.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.521+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:41:53.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.522+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:41:53.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.537+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:41:53.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.552+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:41:53.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.561+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:53.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.567+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:41:53.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.567+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58ee1435:::benchmark_data_smithi165_34272_object2716:head, will try copies on 3,4 2024-09-17T16:41:53.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.580+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:41:53.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.601+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:41:53.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.609+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:41:53.616 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.614+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:41:53.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.618+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:41:53.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.618+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:41:53.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.640+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:41:53.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.646+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:41:53.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.649+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:41:53.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.687+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99f3f449:::benchmark_data_smithi165_34272_object3842:head, will try copies on 0,4 2024-09-17T16:41:53.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.696+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:53.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.702+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:41:53.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.727+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:41:53.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.728+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a962f32:::benchmark_data_smithi165_34272_object3955:head, will try copies on 3,4 2024-09-17T16:41:53.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.729+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:41:53.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.735+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a8b1e5:::benchmark_data_smithi165_34272_object1614:head, will try copies on 0,4 2024-09-17T16:41:53.749 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.746+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:41:53.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.754+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b81492f0:::benchmark_data_smithi165_34272_object1896:head, will try copies on 2,3 2024-09-17T16:41:53.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 330 16 4466301 4466285 845.81 834.688 0.000807396 0.00117154 2024-09-17T16:41:53.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.785+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52663f9b:::benchmark_data_smithi165_34272_object2826:head, will try copies on 3,4 2024-09-17T16:41:53.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.816+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:41:53.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.816+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:41:53.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.833+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:41:53.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.839+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:41:53.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.840+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:41:53.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.844+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:41:53.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.857+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:41:53.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.860+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:41:53.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:41:53.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.886+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:41:53.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.891+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:41:53.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.892+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:41:53.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.904+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bccbc45:::benchmark_data_smithi165_34272_object178:head, will try copies on 3,4 2024-09-17T16:41:53.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.920+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:41:53.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.941+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:41:53.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:53.954+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:41:54.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.007+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:41:54.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.032+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:41:54.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.042+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:41:54.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.049+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:41:54.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.064+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfa7575e:::benchmark_data_smithi165_34272_object1667:head, will try copies on 2,3 2024-09-17T16:41:54.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.073+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:41:54.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.079+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:41:54.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.093+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:41:54.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.096+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5eec7:::benchmark_data_smithi165_34272_object218:head, will try copies on 3,4 2024-09-17T16:41:54.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94179230:::benchmark_data_smithi165_34272_object1114:head, will try copies on 0,4 2024-09-17T16:41:54.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.108+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:41:54.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.119+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:41:54.131 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.128+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:41:54.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.130+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:41:54.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.156+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:41:54.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.161+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:41:54.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.204+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:41:54.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.211+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:41:54.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.219+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:41:54.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.221+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:41:54.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.225+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d177ce8:::benchmark_data_smithi165_34272_object4486:head, will try copies on 0,4 2024-09-17T16:41:54.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.229+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5ce5775:::benchmark_data_smithi165_34272_object3310:head, will try copies on 2,3 2024-09-17T16:41:54.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.237+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:980ae961:::benchmark_data_smithi165_34272_object601:head, will try copies on 0,4 2024-09-17T16:41:54.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.242+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:41:54.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.247+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:41:54.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.275+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:41:54.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.276+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:41:54.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.316+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:41:54.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.318+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:41:54.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.319+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:41:54.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.320+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:41:54.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.349+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:968e867c:::benchmark_data_smithi165_34272_object2406:head, will try copies on 0,4 2024-09-17T16:41:54.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.359+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc7ebede:::benchmark_data_smithi165_34272_object3483:head, will try copies on 2,3 2024-09-17T16:41:54.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.363+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:41:54.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.363+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:54.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.373+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:54.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.380+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:41:54.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.386+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:41:54.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.422+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:41:54.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.422+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:41:54.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.423+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:41:54.427 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.424+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:41:54.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.448+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:622045bb:::benchmark_data_smithi165_34272_object375:head, will try copies on 3,4 2024-09-17T16:41:54.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.463+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:41:54.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.471+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:41:54.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.502+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:41:54.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.507+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:41:54.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.520+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:41:54.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.528+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92500f77:::benchmark_data_smithi165_34272_object3189:head, will try copies on 0,4 2024-09-17T16:41:54.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.545+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:41:54.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.545+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b49d6cf3:::benchmark_data_smithi165_34272_object2403:head, will try copies on 2,3 2024-09-17T16:41:54.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.551+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:41:54.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.555+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:41:54.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.573+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:41:54.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.627+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:41:54.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.635+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:278089a4:::benchmark_data_smithi165_34272_object585:head, will try copies on 0,4 2024-09-17T16:41:54.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.642+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:41:54.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.648+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:41:54.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.668+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:41:54.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.671+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:41:54.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.675+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:41:54.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.679+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:41:54.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.703+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:41:54.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.707+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:41:54.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.742+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:41:54.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.745+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:41:54.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.755+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:41:54.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 331 16 4479241 4479225 845.698 808.75 0.000526134 0.00117171 2024-09-17T16:41:54.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.786+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43b66de:::benchmark_data_smithi165_34272_object1687:head, will try copies on 2,3 2024-09-17T16:41:54.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.799+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:41:54.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.799+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:41:54.804 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.802+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:41:54.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.811+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:41:54.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.822+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:41:54.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.823+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:41:54.827 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.825+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:41:54.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.841+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:41:54.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.863+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:41:54.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.892+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:41:54.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.895+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:41:54.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.896+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:41:54.903 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.901+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:41:54.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.923+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:41:54.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.928+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:41:54.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.943+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:41:54.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.945+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:41:54.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.963+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:41:54.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.969+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:41:54.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.992+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:41:54.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:54.997+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:55.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.002+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:41:55.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.011+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:41:55.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.043+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ceaf5f7:::benchmark_data_smithi165_34272_object2736:head, will try copies on 0,4 2024-09-17T16:41:55.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.062+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:41:55.066 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.064+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:55.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.084+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:55.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.100+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:41:55.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.108+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:41:55.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.108+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:41:55.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.110+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd6e1a1d:::benchmark_data_smithi165_34272_object2801:head, will try copies on 2,3 2024-09-17T16:41:55.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.121+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:41:55.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.140+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:41:55.150 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.148+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:41:55.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.151+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613f587e:::benchmark_data_smithi165_34272_object135:head, will try copies on 3,4 2024-09-17T16:41:55.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.162+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:41:55.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.185+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:41:55.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.204+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:41:55.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.214+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:41:55.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.242+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20811a65:::benchmark_data_smithi165_34272_object3293:head, will try copies on 0,4 2024-09-17T16:41:55.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.244+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:41:55.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.257+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:41:55.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.260+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:41:55.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.276+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5daf0625:::benchmark_data_smithi165_34272_object2680:head, will try copies on 3,4 2024-09-17T16:41:55.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.293+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:41:55.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.305+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:41:55.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.313+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:41:55.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.336+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:41:55.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.341+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:41:55.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.346+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:41:55.355 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.353+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:41:55.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.377+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:55.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.402+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:41:55.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.402+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:55.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.427+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:41:55.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.432+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:55.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.443+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:41:55.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.474+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:41:55.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.484+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:41:55.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.501+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:41:55.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.509+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:41:55.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.513+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:41:55.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.517+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:41:55.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.537+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:41:55.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.539+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:41:55.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.548+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:41:55.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.559+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b3a71a:::benchmark_data_smithi165_34272_object1073:head, will try copies on 0,4 2024-09-17T16:41:55.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.577+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:41:55.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.589+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:41:55.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.593+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:41:55.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.598+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:41:55.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.609+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:41:55.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.612+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:41:55.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.644+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:41:55.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.652+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:41:55.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.660+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:41:55.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.667+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:41:55.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.667+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:41:55.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.679+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:41:55.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.688+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:41:55.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.708+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:41:55.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.713+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:41:55.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.730+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62564c19:::benchmark_data_smithi165_34272_object989:head, will try copies on 3,4 2024-09-17T16:41:55.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.733+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d7de8d:::benchmark_data_smithi165_34272_object2312:head, will try copies on 2,3 2024-09-17T16:41:55.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.736+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:41:55.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.755+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:41:55.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 332 16 4492938 4492922 845.729 856.062 0.000503404 0.0011716 2024-09-17T16:41:55.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.782+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:41:55.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.789+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:41:55.809 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.807+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:41:55.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.820+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:41:55.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.833+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:41:55.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.841+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:41:55.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.845+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:41:55.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.856+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59d6ee77:::benchmark_data_smithi165_34272_object3964:head, will try copies on 3,4 2024-09-17T16:41:55.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.884+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:41:55.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.887+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970e60e0:::benchmark_data_smithi165_34272_object821:head, will try copies on 0,4 2024-09-17T16:41:55.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.890+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:41:55.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.900+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:230e9694:::benchmark_data_smithi165_34272_object1149:head, will try copies on 0,4 2024-09-17T16:41:55.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.909+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:41:55.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.915+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:41:55.935 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.932+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:41:55.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.945+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:41:55.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.953+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:41:55.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:55.967+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:41:56.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.002+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:41:56.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.006+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:41:56.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.020+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:41:56.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.029+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:41:56.035 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.033+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99d7c857:::benchmark_data_smithi165_34272_object4103:head, will try copies on 0,4 2024-09-17T16:41:56.057 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.055+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:41:56.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.056+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:41:56.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.084+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:41:56.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.089+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:56.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.091+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:41:56.114 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.112+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:41:56.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.124+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:41:56.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.130+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:41:56.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.137+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:41:56.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.137+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:41:56.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.169+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:41:56.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.180+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:41:56.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.181+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e6f9ea:::benchmark_data_smithi165_34272_object1823:head, will try copies on 2,3 2024-09-17T16:41:56.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.197+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:41:56.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:41:56.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.219+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:41:56.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.237+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:41:56.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.249+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:41:56.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.258+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:41:56.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.264+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:41:56.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.269+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:41:56.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.286+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:41:56.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.286+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:41:56.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.289+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2579ccea:::benchmark_data_smithi165_34272_object1643:head, will try copies on 0,4 2024-09-17T16:41:56.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.296+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:41:56.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.310+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:41:56.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.329+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5edc1f68:::benchmark_data_smithi165_34272_object4285:head, will try copies on 3,4 2024-09-17T16:41:56.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.344+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:41:56.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.347+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:41:56.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.349+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:41:56.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.364+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:41:56.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.369+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:237fac66:::benchmark_data_smithi165_34272_object3796:head, will try copies on 0,4 2024-09-17T16:41:56.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.390+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d298f8:::benchmark_data_smithi165_34272_object779:head, will try copies on 3,4 2024-09-17T16:41:56.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.392+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d14ee0:::benchmark_data_smithi165_34272_object2878:head, will try copies on 0,4 2024-09-17T16:41:56.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.399+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:41:56.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.402+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:41:56.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.409+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69dd5402:::benchmark_data_smithi165_34272_object2289:head, will try copies on 3,4 2024-09-17T16:41:56.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.441+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:41:56.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.448+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:41:56.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:41:56.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.463+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22a01458:::benchmark_data_smithi165_34272_object3690:head, will try copies on 0,4 2024-09-17T16:41:56.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.471+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9baa459b:::benchmark_data_smithi165_34272_object413:head, will try copies on 0,4 2024-09-17T16:41:56.484 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.482+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:41:56.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.516+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:56.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.522+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:41:56.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:41:56.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.538+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:41:56.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.556+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:41:56.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.557+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba92cdf7:::benchmark_data_smithi165_34272_object492:head, will try copies on 2,3 2024-09-17T16:41:56.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.562+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:41:56.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.568+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d79065:::benchmark_data_smithi165_34272_object1461:head, will try copies on 0,4 2024-09-17T16:41:56.581 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.578+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c10cfd:::benchmark_data_smithi165_34272_object248:head, will try copies on 2,3 2024-09-17T16:41:56.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.585+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:696133fd:::benchmark_data_smithi165_34272_object2134:head, will try copies on 3,4 2024-09-17T16:41:56.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.586+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd23c1f:::benchmark_data_smithi165_34272_object3447:head, will try copies on 3,4 2024-09-17T16:41:56.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.596+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:41:56.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.620+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:41:56.623 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.621+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:41:56.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.624+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:41:56.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.659+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:41:56.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.670+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:56.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.675+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:41:56.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.684+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:41:56.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.692+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:41:56.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.696+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:283ae76a:::benchmark_data_smithi165_34272_object3038:head, will try copies on 0,4 2024-09-17T16:41:56.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.732+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:41:56.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.733+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:41:56.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.736+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:41:56.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.744+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:41:56.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.758+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9db76ca9:::benchmark_data_smithi165_34272_object3026:head, will try copies on 0,4 2024-09-17T16:41:56.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 333 16 4506445 4506429 845.724 844.188 0.00061078 0.00117166 2024-09-17T16:41:56.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.767+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:41:56.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.782+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:41:56.800 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.798+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:41:56.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.824+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:41:56.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.835+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:41:56.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.841+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:41:56.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.844+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:41:56.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.874+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:41:56.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.894+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:41:56.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.900+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:41:56.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.914+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a6fceb:::benchmark_data_smithi165_34272_object4473:head, will try copies on 0,4 2024-09-17T16:41:56.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.923+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24aa9fe4:::benchmark_data_smithi165_34272_object3800:head, will try copies on 0,4 2024-09-17T16:41:56.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.927+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb949590:::benchmark_data_smithi165_34272_object3902:head, will try copies on 2,3 2024-09-17T16:41:56.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.937+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:41:56.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.943+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ba284d:::benchmark_data_smithi165_34272_object26:head, will try copies on 0,4 2024-09-17T16:41:56.953 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.951+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:41:56.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.975+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:41:56.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.976+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:41:56.989 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.987+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:41:57.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.998+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:41:57.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:56.999+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:41:57.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.014+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b60e1e3:::benchmark_data_smithi165_34272_object40:head, will try copies on 3,4 2024-09-17T16:41:57.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.029+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:41:57.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.045+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:41:57.067 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.065+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:41:57.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.074+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:41:57.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.079+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5766f51f:::benchmark_data_smithi165_34272_object4174:head, will try copies on 3,4 2024-09-17T16:41:57.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.100+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:41:57.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.107+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9abf045d:::benchmark_data_smithi165_34272_object2039:head, will try copies on 0,4 2024-09-17T16:41:57.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.130+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:41:57.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.141+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b72fe030:::benchmark_data_smithi165_34272_object649:head, will try copies on 2,3 2024-09-17T16:41:57.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.158+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:41:57.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.160+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24ee7d5b:::benchmark_data_smithi165_34272_object1721:head, will try copies on 0,4 2024-09-17T16:41:57.173 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.171+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61df82fc:::benchmark_data_smithi165_34272_object3436:head, will try copies on 3,4 2024-09-17T16:41:57.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.174+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:41:57.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.194+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c0a82fb:::benchmark_data_smithi165_34272_object1747:head, will try copies on 0,4 2024-09-17T16:41:57.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.196+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:676ef75d:::benchmark_data_smithi165_34272_object1139:head, will try copies on 3,4 2024-09-17T16:41:57.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.211+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:41:57.217 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.215+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:41:57.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.222+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:41:57.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.263+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:41:57.267 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.265+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:41:57.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.268+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:41:57.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.278+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:41:57.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.284+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5032ccf4:::benchmark_data_smithi165_34272_object1607:head, will try copies on 3,4 2024-09-17T16:41:57.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.308+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:41:57.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.310+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:41:57.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.319+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:41:57.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.345+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:41:57.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.348+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56b4a2bb:::benchmark_data_smithi165_34272_object3219:head, will try copies on 3,4 2024-09-17T16:41:57.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.357+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:41:57.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.366+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:41:57.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.370+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:41:57.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.388+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:41:57.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.403+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:41:57.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.409+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:41:57.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.426+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:41:57.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.427+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:41:57.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.431+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:41:57.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.441+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:41:57.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.466+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:41:57.480 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.478+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:41:57.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.487+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb21ce:::benchmark_data_smithi165_34272_object2206:head, will try copies on 3,4 2024-09-17T16:41:57.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.495+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:41:57.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.520+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8e7a6a9:::benchmark_data_smithi165_34272_object511:head, will try copies on 2,3 2024-09-17T16:41:57.549 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.546+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:41:57.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.549+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:41:57.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.555+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:41:57.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.556+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:41:57.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.574+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:41:57.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.582+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:986b240d:::benchmark_data_smithi165_34272_object4507:head, will try copies on 0,4 2024-09-17T16:41:57.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.610+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a57751f:::benchmark_data_smithi165_34272_object3529:head, will try copies on 3,4 2024-09-17T16:41:57.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.611+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:41:57.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.613+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:41:57.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.615+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626b0739:::benchmark_data_smithi165_34272_object1762:head, will try copies on 3,4 2024-09-17T16:41:57.643 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.641+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:41:57.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.648+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:41:57.654 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.652+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:41:57.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.674+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50efa34d:::benchmark_data_smithi165_34272_object2410:head, will try copies on 3,4 2024-09-17T16:41:57.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.678+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:41:57.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.693+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:41:57.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.695+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f21e31:::benchmark_data_smithi165_34272_object3519:head, will try copies on 2,3 2024-09-17T16:41:57.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.697+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:41:57.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.724+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:41:57.737 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.735+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:41:57.745 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.742+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:41:57.752 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.750+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:41:57.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.751+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:41:57.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.760+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:41:57.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 334 16 4520411 4520395 845.805 872.875 0.00061777 0.00117155 2024-09-17T16:41:57.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.789+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:41:57.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.799+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:41:57.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.813+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52ce9a2:::benchmark_data_smithi165_34272_object1764:head, will try copies on 2,3 2024-09-17T16:41:57.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.816+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:41:57.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.819+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:41:57.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.839+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:41:57.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.853+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:41:57.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.862+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:41:57.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.863+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:41:57.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.863+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c6fd0b0:::benchmark_data_smithi165_34272_object3724:head, will try copies on 3,4 2024-09-17T16:41:57.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.871+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:41:57.889 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.887+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:41:57.899 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.897+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6859ec8d:::benchmark_data_smithi165_34272_object3037:head, will try copies on 3,4 2024-09-17T16:41:57.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.906+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:41:57.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.940+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:41:57.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.943+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:41:57.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.954+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:41:57.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.977+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:41:57.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.978+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5987111d:::benchmark_data_smithi165_34272_object3590:head, will try copies on 3,4 2024-09-17T16:41:57.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.978+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:57.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.980+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:41:57.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:57.991+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:41:58.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.023+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:41:58.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.031+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:947911d3:::benchmark_data_smithi165_34272_object2963:head, will try copies on 0,4 2024-09-17T16:41:58.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.040+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:41:58.050 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.048+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:41:58.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.057+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:41:58.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.075+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f2cbf95:::benchmark_data_smithi165_34272_object2663:head, will try copies on 0,4 2024-09-17T16:41:58.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.090+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:41:58.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.096+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9632dc2e:::benchmark_data_smithi165_34272_object4450:head, will try copies on 0,4 2024-09-17T16:41:58.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.097+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:41:58.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.103+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:616788a1:::benchmark_data_smithi165_34272_object927:head, will try copies on 3,4 2024-09-17T16:41:58.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.110+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:58.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.137+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:41:58.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.142+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:41:58.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.166+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e2c2b17:::benchmark_data_smithi165_34272_object2150:head, will try copies on 0,4 2024-09-17T16:41:58.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.180+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:41:58.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.193+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5266f8ca:::benchmark_data_smithi165_34272_object3467:head, will try copies on 3,4 2024-09-17T16:41:58.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.202+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:41:58.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.207+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:41:58.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.233+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:41:58.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.233+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:41:58.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.237+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:41:58.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.244+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:41:58.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.248+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:41:58.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.264+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:41:58.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.286+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57cd7b5a:::benchmark_data_smithi165_34272_object678:head, will try copies on 3,4 2024-09-17T16:41:58.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.295+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:41:58.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.305+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67156d1b:::benchmark_data_smithi165_34272_object4422:head, will try copies on 3,4 2024-09-17T16:41:58.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.309+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f656fe1:::benchmark_data_smithi165_34272_object3498:head, will try copies on 0,4 2024-09-17T16:41:58.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.327+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:41:58.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:41:58.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.357+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:41:58.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.370+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:41:58.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.385+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:41:58.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.391+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ede387:::benchmark_data_smithi165_34272_object3307:head, will try copies on 3,4 2024-09-17T16:41:58.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.410+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:41:58.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.442+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:41:58.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.443+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:41:58.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.455+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:41:58.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.464+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:41:58.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.466+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:41:58.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.484+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:41:58.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.489+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55da3e48:::benchmark_data_smithi165_34272_object539:head, will try copies on 3,4 2024-09-17T16:41:58.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.496+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:41:58.514 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.512+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:41:58.523 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.521+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:41:58.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.523+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:41:58.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.543+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:41:58.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.549+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:41:58.558 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.555+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:41:58.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.558+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c1b42a1:::benchmark_data_smithi165_34272_object580:head, will try copies on 3,4 2024-09-17T16:41:58.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.566+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:41:58.610 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.608+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:41:58.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.608+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:41:58.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.620+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:41:58.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.625+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:41:58.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.637+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:41:58.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.644+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:41:58.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.645+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:41:58.657 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.655+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:41:58.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.668+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:41:58.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.686+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:41:58.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.702+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:41:58.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.703+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b185d4e:::benchmark_data_smithi165_34272_object987:head, will try copies on 0,4 2024-09-17T16:41:58.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.709+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:58.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.717+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:41:58.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.726+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:41:58.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.753+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:41:58.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 335 16 4533860 4533844 845.789 840.562 0.000926514 0.00117157 2024-09-17T16:41:58.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.778+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6771cae0:::benchmark_data_smithi165_34272_object3585:head, will try copies on 3,4 2024-09-17T16:41:58.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.790+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:41:58.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.795+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:41:58.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.797+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:41:58.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.805+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:41:58.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.811+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:41:58.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.828+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:41:58.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.836+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b11417e:::benchmark_data_smithi165_34272_object2429:head, will try copies on 3,4 2024-09-17T16:41:58.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.860+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86b38df:::benchmark_data_smithi165_34272_object3133:head, will try copies on 2,3 2024-09-17T16:41:58.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.862+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:41:58.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.877+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:41:58.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:41:58.902 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.900+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe75730:::benchmark_data_smithi165_34272_object3221:head, will try copies on 0,4 2024-09-17T16:41:58.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.921+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c0e29a:::benchmark_data_smithi165_34272_object1482:head, will try copies on 0,4 2024-09-17T16:41:58.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.935+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:41:58.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.938+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:41:58.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.939+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:41:58.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.948+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:41:58.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.950+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:41:58.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:58.974+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:41:59.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.016+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:41:59.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.017+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:41:59.039 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.037+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:41:59.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.053+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:41:59.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.054+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:41:59.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.063+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:41:59.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.070+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:41:59.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.076+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:41:59.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.084+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d6fb856:::benchmark_data_smithi165_34272_object1400:head, will try copies on 0,4 2024-09-17T16:41:59.119 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.117+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:41:59.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.118+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:41:59.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.124+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:261be45b:::benchmark_data_smithi165_34272_object1780:head, will try copies on 0,4 2024-09-17T16:41:59.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.140+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:41:59.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.155+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:41:59.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.176+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c4f072:::benchmark_data_smithi165_34272_object2061:head, will try copies on 2,3 2024-09-17T16:41:59.179 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.177+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:41:59.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.183+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ab3eade:::benchmark_data_smithi165_34272_object4382:head, will try copies on 3,4 2024-09-17T16:41:59.190 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.188+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:507f22ae:::benchmark_data_smithi165_34272_object2227:head, will try copies on 3,4 2024-09-17T16:41:59.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.201+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:41:59.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.203+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:41:59.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.211+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:41:59.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.229+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:41:59.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.238+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:41:59.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.244+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:41:59.252 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.250+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:41:59.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.267+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:41:59.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.278+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:41:59.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.282+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:41:59.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.283+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:41:59.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.308+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:41:59.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.309+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24da6b96:::benchmark_data_smithi165_34272_object3655:head, will try copies on 0,4 2024-09-17T16:41:59.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.341+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63504a0a:::benchmark_data_smithi165_34272_object2568:head, will try copies on 3,4 2024-09-17T16:41:59.351 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.348+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:41:59.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.359+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9677bb54:::benchmark_data_smithi165_34272_object2254:head, will try copies on 0,4 2024-09-17T16:41:59.368 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.366+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:41:59.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.369+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:41:59.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.382+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:41:59.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.388+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:41:59.396 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.394+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df640f7:::benchmark_data_smithi165_34272_object4042:head, will try copies on 3,4 2024-09-17T16:41:59.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.404+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:41:59.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.415+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:41:59.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.432+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:41:59.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.433+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:41:59.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.451+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:41:59.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.463+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:41:59.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.472+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:41:59.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.476+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b736997:::benchmark_data_smithi165_34272_object563:head, will try copies on 3,4 2024-09-17T16:41:59.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.491+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96a05ca6:::benchmark_data_smithi165_34272_object2490:head, will try copies on 0,4 2024-09-17T16:41:59.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.505+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:41:59.533 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.531+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:41:59.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.540+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6309a6fb:::benchmark_data_smithi165_34272_object4288:head, will try copies on 3,4 2024-09-17T16:41:59.551 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.549+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:41:59.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.560+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:41:59.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.561+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:41:59.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.580+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:41:59.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.583+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:41:59.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.586+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a7df5e:::benchmark_data_smithi165_34272_object381:head, will try copies on 2,3 2024-09-17T16:41:59.592 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.590+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61ff7ad7:::benchmark_data_smithi165_34272_object1531:head, will try copies on 3,4 2024-09-17T16:41:59.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.613+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:41:59.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.628+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:41:59.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.646+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:41:59.656 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.654+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:41:59.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.674+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62e75d1a:::benchmark_data_smithi165_34272_object849:head, will try copies on 3,4 2024-09-17T16:41:59.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.678+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527c3e1e:::benchmark_data_smithi165_34272_object2318:head, will try copies on 3,4 2024-09-17T16:41:59.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.684+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:41:59.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.691+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:41:59.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.713+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94348301:::benchmark_data_smithi165_34272_object1348:head, will try copies on 0,4 2024-09-17T16:41:59.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.726+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c26ccc3:::benchmark_data_smithi165_34272_object354:head, will try copies on 0,4 2024-09-17T16:41:59.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.736+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:41:59.742 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.739+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:41:59.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.758+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:41:59.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.763+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:41:59.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 336 16 4547274 4547258 845.767 838.375 0.0010123 0.00117161 2024-09-17T16:41:59.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.769+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:41:59.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.778+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:41:59.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.796+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:41:59.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.821+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e0cf48:::benchmark_data_smithi165_34272_object4088:head, will try copies on 3,4 2024-09-17T16:41:59.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.822+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:41:59.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.828+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b51d8ec:::benchmark_data_smithi165_34272_object1648:head, will try copies on 3,4 2024-09-17T16:41:59.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.844+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:41:59.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.888+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:41:59.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.895+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:41:59.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.895+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:41:59.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.930+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:41:59.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.937+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:41:59.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.939+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:41:59.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.952+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:41:59.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.977+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:41:59.986 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.984+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68118013:::benchmark_data_smithi165_34272_object910:head, will try copies on 3,4 2024-09-17T16:41:59.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.989+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:42:00.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:41:59.998+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b85b54f6:::benchmark_data_smithi165_34272_object171:head, will try copies on 2,3 2024-09-17T16:42:00.014 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.011+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:42:00.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.013+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:42:00.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.029+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:42:00.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.038+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:42:00.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.056+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:42:00.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.067+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f05a18a:::benchmark_data_smithi165_34272_object3134:head, will try copies on 0,4 2024-09-17T16:42:00.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.071+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:42:00.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.075+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:42:00.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.090+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:42:00.115 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.112+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:42:00.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.122+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c80baaa:::benchmark_data_smithi165_34272_object725:head, will try copies on 0,4 2024-09-17T16:42:00.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.126+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be00225:::benchmark_data_smithi165_34272_object3478:head, will try copies on 3,4 2024-09-17T16:42:00.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.133+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:42:00.151 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.149+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:42:00.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.162+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:42:00.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.172+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:42:00.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.174+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:42:00.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.184+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:42:00.215 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.213+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24845cb9:::benchmark_data_smithi165_34272_object1938:head, will try copies on 0,4 2024-09-17T16:42:00.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.218+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:42:00.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.222+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:42:00.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.234+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:42:00.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.261+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6404cc1d:::benchmark_data_smithi165_34272_object3147:head, will try copies on 3,4 2024-09-17T16:42:00.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.264+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:42:00.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.294+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:42:00.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.307+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:42:00.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.318+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:42:00.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.333+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:42:00.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.338+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:42:00.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.371+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be372326:::benchmark_data_smithi165_34272_object4172:head, will try copies on 2,3 2024-09-17T16:42:00.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.379+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:42:00.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.405+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b89b80d:::benchmark_data_smithi165_34272_object9:head, will try copies on 3,4 2024-09-17T16:42:00.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.421+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:42:00.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.438+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:42:00.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.440+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:584f9e1c:::benchmark_data_smithi165_34272_object2803:head, will try copies on 3,4 2024-09-17T16:42:00.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.453+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b42085fb:::benchmark_data_smithi165_34272_object1700:head, will try copies on 2,3 2024-09-17T16:42:00.464 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.462+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:42:00.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.477+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b11f686b:::benchmark_data_smithi165_34272_object2218:head, will try copies on 2,3 2024-09-17T16:42:00.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.488+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:42:00.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.506+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:42:00.511 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.508+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:42:00.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.539+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:42:00.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.541+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:42:00.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.552+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:42:00.559 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.557+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:42:00.571 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.569+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:42:00.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.589+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:42:00.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.599+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:42:00.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.601+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:42:00.605 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.603+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:42:00.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.619+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:213ef651:::benchmark_data_smithi165_34272_object852:head, will try copies on 0,4 2024-09-17T16:42:00.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.627+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f8e640:::benchmark_data_smithi165_34272_object3490:head, will try copies on 2,3 2024-09-17T16:42:00.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.653+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:42:00.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:42:00.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.666+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:42:00.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.695+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:42:00.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.695+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:42:00.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.697+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:42:00.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.708+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ad64099:::benchmark_data_smithi165_34272_object2557:head, will try copies on 3,4 2024-09-17T16:42:00.723 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.721+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:42:00.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 337 16 4560669 4560653 845.741 837.188 0.000385864 0.0011715 2024-09-17T16:42:00.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.784+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a32714:::benchmark_data_smithi165_34272_object2483:head, will try copies on 2,3 2024-09-17T16:42:00.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.785+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:42:00.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.791+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:42:00.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.815+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cccdad8:::benchmark_data_smithi165_34272_object2548:head, will try copies on 3,4 2024-09-17T16:42:00.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.817+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:42:00.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.851+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:42:00.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.855+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:42:00.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.879+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3e4110c:::benchmark_data_smithi165_34272_object1730:head, will try copies on 2,3 2024-09-17T16:42:00.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.883+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29934f46:::benchmark_data_smithi165_34272_object681:head, will try copies on 0,4 2024-09-17T16:42:00.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.903+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:42:00.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.923+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:234c76fd:::benchmark_data_smithi165_34272_object1163:head, will try copies on 0,4 2024-09-17T16:42:00.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.926+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:42:00.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.940+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:914fffcd:::benchmark_data_smithi165_34272_object2351:head, will try copies on 0,4 2024-09-17T16:42:00.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.942+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:42:00.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.946+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:42:00.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.956+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:42:00.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.980+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:42:00.992 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.989+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b873406f:::benchmark_data_smithi165_34272_object2989:head, will try copies on 2,3 2024-09-17T16:42:00.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.991+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:42:00.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:00.994+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:42:01.017 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.015+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:42:01.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.016+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:42:01.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.034+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dfb6b1:::benchmark_data_smithi165_34272_object4502:head, will try copies on 0,4 2024-09-17T16:42:01.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.038+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:42:01.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.044+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:42:01.070 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.068+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:42:01.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.076+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:42:01.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.080+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:42:01.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.090+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:42:01.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.099+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:42:01.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.116+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:42:01.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.127+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:42:01.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.140+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:42:01.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.141+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:42:01.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.152+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a8dc868:::benchmark_data_smithi165_34272_object4257:head, will try copies on 3,4 2024-09-17T16:42:01.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.176+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:42:01.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.182+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:42:01.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.196+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:42:01.203 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.201+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:42:01.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.227+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:42:01.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.242+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6766823c:::benchmark_data_smithi165_34272_object1532:head, will try copies on 3,4 2024-09-17T16:42:01.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.245+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:42:01.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.253+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:42:01.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.256+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:42:01.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.274+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:42:01.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.281+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:42:01.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.282+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:42:01.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.283+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:42:01.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.319+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:42:01.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.327+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:42:01.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.338+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:42:01.357 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.354+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:42:01.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.362+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65aa52a9:::benchmark_data_smithi165_34272_object1756:head, will try copies on 3,4 2024-09-17T16:42:01.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.362+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:42:01.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.375+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51611b56:::benchmark_data_smithi165_34272_object4378:head, will try copies on 3,4 2024-09-17T16:42:01.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.391+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98577dd0:::benchmark_data_smithi165_34272_object3957:head, will try copies on 0,4 2024-09-17T16:42:01.404 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.401+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:42:01.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.413+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:42:01.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.428+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:42:01.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.434+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69c46a68:::benchmark_data_smithi165_34272_object3304:head, will try copies on 3,4 2024-09-17T16:42:01.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.445+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945650b8:::benchmark_data_smithi165_34272_object3052:head, will try copies on 0,4 2024-09-17T16:42:01.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.448+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:42:01.476 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.473+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:42:01.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.475+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:42:01.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.476+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:42:01.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.489+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:510c476e:::benchmark_data_smithi165_34272_object2190:head, will try copies on 3,4 2024-09-17T16:42:01.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.490+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c33da6e:::benchmark_data_smithi165_34272_object1155:head, will try copies on 3,4 2024-09-17T16:42:01.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.504+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:42:01.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.532+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:42:01.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.535+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:42:01.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.541+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:42:01.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.550+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:42:01.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.551+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:42:01.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.574+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:589656ff:::benchmark_data_smithi165_34272_object842:head, will try copies on 3,4 2024-09-17T16:42:01.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.585+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:42:01.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.603+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:42:01.615 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:697a9f12:::benchmark_data_smithi165_34272_object3008:head, will try copies on 3,4 2024-09-17T16:42:01.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.625+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc43380:::benchmark_data_smithi165_34272_object532:head, will try copies on 0,4 2024-09-17T16:42:01.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.629+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:42:01.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.634+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:42:01.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.645+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:42:01.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.663+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:42:01.677 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.675+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25005cc8:::benchmark_data_smithi165_34272_object4485:head, will try copies on 0,4 2024-09-17T16:42:01.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.675+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:42:01.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.692+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:42:01.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.708+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:42:01.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.712+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:42:01.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.716+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:42:01.754 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.752+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:42:01.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.752+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94e41607:::benchmark_data_smithi165_34272_object3141:head, will try copies on 0,4 2024-09-17T16:42:01.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 338 16 4573820 4573804 845.671 821.938 0.00280513 0.00117174 2024-09-17T16:42:01.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.769+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:42:01.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.786+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:42:01.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.796+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:42:01.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.804+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:42:01.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.817+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6672cd7a:::benchmark_data_smithi165_34272_object3785:head, will try copies on 3,4 2024-09-17T16:42:01.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.851+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:42:01.868 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.865+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:42:01.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:42:01.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.883+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:42:01.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.890+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:42:01.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.910+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:42:01.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.924+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90e0dab1:::benchmark_data_smithi165_34272_object348:head, will try copies on 0,4 2024-09-17T16:42:01.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.940+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:42:01.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.946+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:42:01.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.967+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:42:01.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.967+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:42:01.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.989+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:42:02.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:01.998+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:42:02.013 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.010+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:42:02.015 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.013+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:42:02.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.021+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:42:02.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.038+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:42:02.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.069+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b00082d9:::benchmark_data_smithi165_34272_object4209:head, will try copies on 2,3 2024-09-17T16:42:02.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.073+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:607482d1:::benchmark_data_smithi165_34272_object3740:head, will try copies on 3,4 2024-09-17T16:42:02.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.081+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:42:02.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.096+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:42:02.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.101+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:42:02.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.114+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:42:02.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.114+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:42:02.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.126+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:42:02.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.127+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:42:02.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.128+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:42:02.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.139+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9070c5e8:::benchmark_data_smithi165_34272_object3555:head, will try copies on 0,4 2024-09-17T16:42:02.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.166+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:42:02.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.168+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:42:02.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.174+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b593c5d6:::benchmark_data_smithi165_34272_object3817:head, will try copies on 2,3 2024-09-17T16:42:02.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.191+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:42:02.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.210+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:42:02.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.242+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:42:02.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.247+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5598331f:::benchmark_data_smithi165_34272_object4560:head, will try copies on 3,4 2024-09-17T16:42:02.253 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.250+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:42:02.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.274+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ffb2ef7:::benchmark_data_smithi165_34272_object4296:head, will try copies on 3,4 2024-09-17T16:42:02.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.282+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:42:02.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.283+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:42:02.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.306+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:42:02.315 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.313+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:42:02.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.329+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e8a88f6:::benchmark_data_smithi165_34272_object286:head, will try copies on 0,4 2024-09-17T16:42:02.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.339+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8e99f4:::benchmark_data_smithi165_34272_object3145:head, will try copies on 3,4 2024-09-17T16:42:02.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.356+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:42:02.373 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.371+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:42:02.383 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.381+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb24768:::benchmark_data_smithi165_34272_object423:head, will try copies on 0,4 2024-09-17T16:42:02.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:42:02.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.409+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:42:02.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.412+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:42:02.418 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.416+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:42:02.425 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.422+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:42:02.439 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.437+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dbf8007:::benchmark_data_smithi165_34272_object872:head, will try copies on 3,4 2024-09-17T16:42:02.465 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.463+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25aca4b8:::benchmark_data_smithi165_34272_object310:head, will try copies on 0,4 2024-09-17T16:42:02.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.472+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:42:02.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.476+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:42:02.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.485+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:42:02.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.496+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:42:02.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.516+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9731630a:::benchmark_data_smithi165_34272_object2326:head, will try copies on 0,4 2024-09-17T16:42:02.521 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.519+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:42:02.617 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.615+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:42:02.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.616+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:42:02.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.651+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:42:02.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.655+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21e8c711:::benchmark_data_smithi165_34272_object1218:head, will try copies on 0,4 2024-09-17T16:42:02.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.689+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:42:02.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.697+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97f82e50:::benchmark_data_smithi165_34272_object2359:head, will try copies on 0,4 2024-09-17T16:42:02.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.701+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68603ed6:::benchmark_data_smithi165_34272_object1086:head, will try copies on 3,4 2024-09-17T16:42:02.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.701+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:42:02.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.707+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c74af04:::benchmark_data_smithi165_34272_object3754:head, will try copies on 0,4 2024-09-17T16:42:02.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.712+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:42:02.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.734+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:42:02.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.742+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:42:02.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.742+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5dd4f50:::benchmark_data_smithi165_34272_object2572:head, will try copies on 2,3 2024-09-17T16:42:02.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.761+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:42:02.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 339 16 4586509 4586493 845.515 793.062 0.000632059 0.00117196 2024-09-17T16:42:02.776 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.774+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:42:02.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.789+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:42:02.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.790+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:42:02.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.794+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:42:02.806 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.804+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87d70e:::benchmark_data_smithi165_34272_object4011:head, will try copies on 0,4 2024-09-17T16:42:02.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.839+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:42:02.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.866+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:42:02.871 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.869+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51618a46:::benchmark_data_smithi165_34272_object1746:head, will try copies on 3,4 2024-09-17T16:42:02.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.905+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:42:02.909 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.907+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:42:02.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.911+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:42:02.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.924+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6c27aaf:::benchmark_data_smithi165_34272_object301:head, will try copies on 2,3 2024-09-17T16:42:02.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.932+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff4688d:::benchmark_data_smithi165_34272_object104:head, will try copies on 0,4 2024-09-17T16:42:02.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.937+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b0e3e5d:::benchmark_data_smithi165_34272_object1841:head, will try copies on 3,4 2024-09-17T16:42:02.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.945+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51d1e42b:::benchmark_data_smithi165_34272_object193:head, will try copies on 3,4 2024-09-17T16:42:02.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.947+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b92f6f7e:::benchmark_data_smithi165_34272_object764:head, will try copies on 2,3 2024-09-17T16:42:02.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.971+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:42:03.000 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:02.997+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:42:03.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.001+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:42:03.025 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.021+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:42:03.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.027+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:42:03.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.028+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:42:03.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.029+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:42:03.051 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.048+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:42:03.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.056+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51778106:::benchmark_data_smithi165_34272_object4389:head, will try copies on 3,4 2024-09-17T16:42:03.078 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.076+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b568cc:::benchmark_data_smithi165_34272_object2291:head, will try copies on 3,4 2024-09-17T16:42:03.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.081+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e6127ee:::benchmark_data_smithi165_34272_object1260:head, will try copies on 0,4 2024-09-17T16:42:03.109 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.107+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:42:03.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.108+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:42:03.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.137+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:42:03.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.145+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65e64019:::benchmark_data_smithi165_34272_object3556:head, will try copies on 3,4 2024-09-17T16:42:03.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.160+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:42:03.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.172+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:42:03.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.183+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:42:03.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.197+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c40cef8:::benchmark_data_smithi165_34272_object731:head, will try copies on 0,4 2024-09-17T16:42:03.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.198+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:42:03.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.213+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:42:03.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.216+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:42:03.232 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.230+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee69708:::benchmark_data_smithi165_34272_object3753:head, will try copies on 3,4 2024-09-17T16:42:03.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.232+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:42:03.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.237+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:42:03.243 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.241+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:42:03.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.245+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:42:03.260 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.257+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:42:03.289 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.287+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:42:03.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.293+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:42:03.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.294+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:244ffcbf:::benchmark_data_smithi165_34272_object767:head, will try copies on 0,4 2024-09-17T16:42:03.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.294+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:42:03.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.296+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:42:03.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.319+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f34f824:::benchmark_data_smithi165_34272_object2130:head, will try copies on 0,4 2024-09-17T16:42:03.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.330+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:549abb54:::benchmark_data_smithi165_34272_object3588:head, will try copies on 3,4 2024-09-17T16:42:03.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.338+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:42:03.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.347+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:42:03.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.382+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d673162:::benchmark_data_smithi165_34272_object4271:head, will try copies on 0,4 2024-09-17T16:42:03.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.396+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e087c1c:::benchmark_data_smithi165_34272_object1209:head, will try copies on 3,4 2024-09-17T16:42:03.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.407+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:42:03.419 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.417+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d99c6:::benchmark_data_smithi165_34272_object3566:head, will try copies on 2,3 2024-09-17T16:42:03.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.430+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:42:03.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.435+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:42:03.456 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.453+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbf74cfa:::benchmark_data_smithi165_34272_object1142:head, will try copies on 2,3 2024-09-17T16:42:03.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.465+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58125dc3:::benchmark_data_smithi165_34272_object2339:head, will try copies on 3,4 2024-09-17T16:42:03.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.487+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ac60ff8:::benchmark_data_smithi165_34272_object3602:head, will try copies on 3,4 2024-09-17T16:42:03.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.488+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:42:03.503 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.501+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:42:03.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.509+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:42:03.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.510+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d7a45a6:::benchmark_data_smithi165_34272_object1072:head, will try copies on 3,4 2024-09-17T16:42:03.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.520+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:42:03.527 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.524+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e2a6f25:::benchmark_data_smithi165_34272_object3403:head, will try copies on 0,4 2024-09-17T16:42:03.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.553+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:42:03.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.562+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:42:03.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.565+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:42:03.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.583+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b374abe7:::benchmark_data_smithi165_34272_object2542:head, will try copies on 2,3 2024-09-17T16:42:03.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.604+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:42:03.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.623+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:42:03.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.625+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:42:03.649 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.647+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d64f30b:::benchmark_data_smithi165_34272_object699:head, will try copies on 3,4 2024-09-17T16:42:03.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.650+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:42:03.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.662+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b7166dc:::benchmark_data_smithi165_34272_object16:head, will try copies on 3,4 2024-09-17T16:42:03.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.671+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:42:03.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.681+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:42:03.684 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.682+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:531a006c:::benchmark_data_smithi165_34272_object3867:head, will try copies on 3,4 2024-09-17T16:42:03.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.684+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b6ab2d1:::benchmark_data_smithi165_34272_object2405:head, will try copies on 0,4 2024-09-17T16:42:03.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.710+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:42:03.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.713+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c98d561:::benchmark_data_smithi165_34272_object3596:head, will try copies on 0,4 2024-09-17T16:42:03.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.719+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:42:03.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.736+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:42:03.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.746+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21815fb1:::benchmark_data_smithi165_34272_object845:head, will try copies on 0,4 2024-09-17T16:42:03.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.754+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:42:03.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.759+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:42:03.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:2024-09-17T16:42:03.766737+0000 min lat: 0.000227768 max lat: 0.222415 avg lat: 0.00117197 2024-09-17T16:42:03.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-17T16:42:03.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 340 16 4600036 4600020 845.515 845.438 0.000763418 0.00117197 2024-09-17T16:42:03.782 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.779+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:42:03.796 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.792+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:42:03.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.804+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5905c587:::benchmark_data_smithi165_34272_object1445:head, will try copies on 3,4 2024-09-17T16:42:03.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.806+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:42:03.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.822+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:42:03.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.823+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:42:03.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.828+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:42:03.841 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.839+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d159032:::benchmark_data_smithi165_34272_object3124:head, will try copies on 3,4 2024-09-17T16:42:03.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.863+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:42:03.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.879+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:42:03.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.881+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b191d406:::benchmark_data_smithi165_34272_object2999:head, will try copies on 2,3 2024-09-17T16:42:03.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.882+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:42:03.907 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.904+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:42:03.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.911+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:42:03.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.928+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:42:03.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.945+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:614bd1cd:::benchmark_data_smithi165_34272_object4455:head, will try copies on 3,4 2024-09-17T16:42:03.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.954+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:246195f9:::benchmark_data_smithi165_34272_object2330:head, will try copies on 0,4 2024-09-17T16:42:03.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.959+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:42:03.962 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.960+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:42:03.977 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.975+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:42:03.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:03.994+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5884995b:::benchmark_data_smithi165_34272_object4321:head, will try copies on 3,4 2024-09-17T16:42:04.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.025+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5b250f2:::benchmark_data_smithi165_34272_object4529:head, will try copies on 2,3 2024-09-17T16:42:04.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.027+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:42:04.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.032+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5045aa4e:::benchmark_data_smithi165_34272_object2413:head, will try copies on 3,4 2024-09-17T16:42:04.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.047+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:42:04.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.050+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:42:04.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.063+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:42:04.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.074+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:42:04.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.098+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:42:04.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.110+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96837985:::benchmark_data_smithi165_34272_object841:head, will try copies on 0,4 2024-09-17T16:42:04.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.134+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4aba91c:::benchmark_data_smithi165_34272_object3834:head, will try copies on 2,3 2024-09-17T16:42:04.137 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.135+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:42:04.145 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.143+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:42:04.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.155+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:42:04.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.161+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53110f6f:::benchmark_data_smithi165_34272_object4420:head, will try copies on 3,4 2024-09-17T16:42:04.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.172+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:42:04.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.200+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:42:04.204 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.201+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d5e6c63:::benchmark_data_smithi165_34272_object84:head, will try copies on 0,4 2024-09-17T16:42:04.210 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.208+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:42:04.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.210+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:42:04.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.227+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:42:04.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.231+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:42:04.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.249+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:42:04.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.271+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:42:04.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.289+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f909a6:::benchmark_data_smithi165_34272_object4243:head, will try copies on 3,4 2024-09-17T16:42:04.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.294+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a7871d7:::benchmark_data_smithi165_34272_object1105:head, will try copies on 3,4 2024-09-17T16:42:04.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.314+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:42:04.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.317+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:42:04.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.329+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:42:04.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.330+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:42:04.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.335+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969e67ce:::benchmark_data_smithi165_34272_object3459:head, will try copies on 0,4 2024-09-17T16:42:04.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.340+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:42:04.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.359+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:42:04.379 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.377+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a530e4e:::benchmark_data_smithi165_34272_object2041:head, will try copies on 0,4 2024-09-17T16:42:04.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.386+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:42:04.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.396+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:42:04.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.410+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:42:04.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.430+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b533a8aa:::benchmark_data_smithi165_34272_object2871:head, will try copies on 2,3 2024-09-17T16:42:04.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.431+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98423504:::benchmark_data_smithi165_34272_object3081:head, will try copies on 0,4 2024-09-17T16:42:04.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.440+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:42:04.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.458+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:42:04.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.459+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:42:04.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.464+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:42:04.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.468+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:42:04.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.490+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:42:04.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.516+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:42:04.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.536+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:42:04.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.539+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:42:04.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.541+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:42:04.568 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.566+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf510fba:::benchmark_data_smithi165_34272_object3201:head, will try copies on 2,3 2024-09-17T16:42:04.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.570+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b3d8f4a:::benchmark_data_smithi165_34272_object3444:head, will try copies on 0,4 2024-09-17T16:42:04.602 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.600+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:42:04.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.620+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:42:04.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.627+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9050faf0:::benchmark_data_smithi165_34272_object3995:head, will try copies on 0,4 2024-09-17T16:42:04.634 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.632+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f6f6ac:::benchmark_data_smithi165_34272_object1473:head, will try copies on 3,4 2024-09-17T16:42:04.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.633+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:42:04.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.645+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56644dcd:::benchmark_data_smithi165_34272_object278:head, will try copies on 3,4 2024-09-17T16:42:04.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.648+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cf8f8f7:::benchmark_data_smithi165_34272_object2398:head, will try copies on 0,4 2024-09-17T16:42:04.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.648+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27f96785:::benchmark_data_smithi165_34272_object2922:head, will try copies on 0,4 2024-09-17T16:42:04.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.669+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6acea39:::benchmark_data_smithi165_34272_object753:head, will try copies on 2,3 2024-09-17T16:42:04.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.689+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:42:04.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.690+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fd7e97a:::benchmark_data_smithi165_34272_object2475:head, will try copies on 3,4 2024-09-17T16:42:04.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.709+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb39897c:::benchmark_data_smithi165_34272_object3683:head, will try copies on 2,3 2024-09-17T16:42:04.738 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.736+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:42:04.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.739+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:42:04.756 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.754+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6fa35e4:::benchmark_data_smithi165_34272_object3302:head, will try copies on 2,3 2024-09-17T16:42:04.761 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.759+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:42:04.767 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 341 15 4613397 4613382 845.484 835.125 0.00086054 0.00117201 2024-09-17T16:42:04.768 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.765+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:42:04.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.773+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:42:04.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.793+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:42:04.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.796+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b62cadd9:::benchmark_data_smithi165_34272_object1238:head, will try copies on 2,3 2024-09-17T16:42:04.817 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.815+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:42:04.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.825+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5155e828:::benchmark_data_smithi165_34272_object948:head, will try copies on 3,4 2024-09-17T16:42:04.843 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.841+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:42:04.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.861+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:42:04.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.861+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:42:04.877 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.875+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:42:04.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.878+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:42:04.897 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.895+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cde20a:::benchmark_data_smithi165_34272_object3500:head, will try copies on 3,4 2024-09-17T16:42:04.908 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.905+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:42:04.916 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.914+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:42:04.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.919+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:42:04.929 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.927+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:42:04.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.967+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:42:04.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.973+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:42:04.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.978+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:42:04.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:04.985+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20762e84:::benchmark_data_smithi165_34272_object357:head, will try copies on 0,4 2024-09-17T16:42:05.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.017+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5647baab:::benchmark_data_smithi165_34272_object73:head, will try copies on 3,4 2024-09-17T16:42:05.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.026+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b274b94a:::benchmark_data_smithi165_34272_object2008:head, will try copies on 2,3 2024-09-17T16:42:05.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.026+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61914d5b:::benchmark_data_smithi165_34272_object451:head, will try copies on 3,4 2024-09-17T16:42:05.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:42:05.071 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.069+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:42:05.075 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.073+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dd24a9f:::benchmark_data_smithi165_34272_object4023:head, will try copies on 3,4 2024-09-17T16:42:05.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.076+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79183a9:::benchmark_data_smithi165_34272_object2381:head, will try copies on 2,3 2024-09-17T16:42:05.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.082+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:985d0fe5:::benchmark_data_smithi165_34272_object203:head, will try copies on 0,4 2024-09-17T16:42:05.110 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.107+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:42:05.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.123+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0c259ae:::benchmark_data_smithi165_34272_object2832:head, will try copies on 2,3 2024-09-17T16:42:05.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.123+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:265e5ed8:::benchmark_data_smithi165_34272_object3979:head, will try copies on 0,4 2024-09-17T16:42:05.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.136+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:42:05.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.167+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:42:05.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.168+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:42:05.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.180+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:42:05.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.184+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a8ee58:::benchmark_data_smithi165_34272_object1575:head, will try copies on 3,4 2024-09-17T16:42:05.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.194+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:42:05.233 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.231+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:42:05.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.232+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:42:05.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.246+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b21551b3:::benchmark_data_smithi165_34272_object3930:head, will try copies on 2,3 2024-09-17T16:42:05.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.248+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69d8dfe6:::benchmark_data_smithi165_34272_object4258:head, will try copies on 3,4 2024-09-17T16:42:05.272 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.269+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:42:05.314 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.312+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:42:05.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.337+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28877ec8:::benchmark_data_smithi165_34272_object3036:head, will try copies on 0,4 2024-09-17T16:42:05.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.338+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65c40aff:::benchmark_data_smithi165_34272_object3734:head, will try copies on 3,4 2024-09-17T16:42:05.343 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.341+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5534aee7:::benchmark_data_smithi165_34272_object4273:head, will try copies on 3,4 2024-09-17T16:42:05.366 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.364+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6a8fd5:::benchmark_data_smithi165_34272_object1804:head, will try copies on 2,3 2024-09-17T16:42:05.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.388+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:42:05.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.394+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:42:05.397 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.395+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:928ef9b2:::benchmark_data_smithi165_34272_object1487:head, will try copies on 0,4 2024-09-17T16:42:05.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.401+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:42:05.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.439+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:42:05.455 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.452+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1ca455a:::benchmark_data_smithi165_34272_object1890:head, will try copies on 2,3 2024-09-17T16:42:05.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.478+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:42:05.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.481+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:42:05.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.490+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:42:05.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.495+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c53b611:::benchmark_data_smithi165_34272_object1897:head, will try copies on 3,4 2024-09-17T16:42:05.510 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.508+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:42:05.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.516+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc267328:::benchmark_data_smithi165_34272_object3247:head, will try copies on 2,3 2024-09-17T16:42:05.530 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.528+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:42:05.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.544+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:555af846:::benchmark_data_smithi165_34272_object3572:head, will try copies on 3,4 2024-09-17T16:42:05.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.547+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:42:05.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.567+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:42:05.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.583+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:42:05.589 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.587+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:42:05.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.593+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:42:05.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.620+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:42:05.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.633+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:42:05.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.633+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:42:05.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.662+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bba7d03e:::benchmark_data_smithi165_34272_object3451:head, will try copies on 2,3 2024-09-17T16:42:05.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.671+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ac5bb8e:::benchmark_data_smithi165_34272_object396:head, will try copies on 3,4 2024-09-17T16:42:05.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.693+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:42:05.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.694+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:42:05.705 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.702+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:42:05.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.704+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bce6f77:::benchmark_data_smithi165_34272_object1001:head, will try copies on 0,4 2024-09-17T16:42:05.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.708+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:42:05.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.716+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:42:05.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.726+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5569722:::benchmark_data_smithi165_34272_object54:head, will try copies on 2,3 2024-09-17T16:42:05.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.748+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dba8035:::benchmark_data_smithi165_34272_object3782:head, will try copies on 3,4 2024-09-17T16:42:05.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.756+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2df57ae8:::benchmark_data_smithi165_34272_object2707:head, will try copies on 0,4 2024-09-17T16:42:05.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 342 16 4627338 4627322 845.559 871.25 0.000511386 0.00117189 2024-09-17T16:42:05.813 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.809+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:42:05.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.814+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:42:05.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.819+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:42:05.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.849+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94f3aa00:::benchmark_data_smithi165_34272_object2378:head, will try copies on 0,4 2024-09-17T16:42:05.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:42:05.867 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.865+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:42:05.886 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.883+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:42:05.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.893+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf79a130:::benchmark_data_smithi165_34272_object333:head, will try copies on 2,3 2024-09-17T16:42:05.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.910+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:42:05.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.910+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:42:05.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.929+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b563aca0:::benchmark_data_smithi165_34272_object1684:head, will try copies on 2,3 2024-09-17T16:42:05.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.952+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:945b8d5c:::benchmark_data_smithi165_34272_object3125:head, will try copies on 0,4 2024-09-17T16:42:05.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.959+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:42:05.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.983+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:42:05.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:05.996+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:42:06.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.020+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:42:06.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.029+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:42:06.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.034+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a4d746:::benchmark_data_smithi165_34272_object2654:head, will try copies on 3,4 2024-09-17T16:42:06.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.036+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:42:06.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.040+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:42:06.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.061+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:42:06.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.072+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ce767c:::benchmark_data_smithi165_34272_object2522:head, will try copies on 2,3 2024-09-17T16:42:06.077 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.074+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:42:06.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.087+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fc883:::benchmark_data_smithi165_34272_object322:head, will try copies on 0,4 2024-09-17T16:42:06.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.099+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fe7f46c:::benchmark_data_smithi165_34272_object1701:head, will try copies on 3,4 2024-09-17T16:42:06.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.100+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:42:06.102 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.100+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:42:06.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.116+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:42:06.122 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.120+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64fc41b1:::benchmark_data_smithi165_34272_object1777:head, will try copies on 3,4 2024-09-17T16:42:06.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.124+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e33457d:::benchmark_data_smithi165_34272_object2231:head, will try copies on 3,4 2024-09-17T16:42:06.127 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.124+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:42:06.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.151+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:42:06.158 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.156+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:42:06.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.177+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:42:06.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.178+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fe6cbf:::benchmark_data_smithi165_34272_object1621:head, will try copies on 0,4 2024-09-17T16:42:06.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.181+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:42:06.191 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.189+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:574fea49:::benchmark_data_smithi165_34272_object383:head, will try copies on 3,4 2024-09-17T16:42:06.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.200+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:42:06.214 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.212+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:42:06.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.239+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:42:06.241 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.239+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:42:06.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.261+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda498f1:::benchmark_data_smithi165_34272_object3265:head, will try copies on 2,3 2024-09-17T16:42:06.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.267+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:42:06.276 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.274+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21437659:::benchmark_data_smithi165_34272_object4454:head, will try copies on 0,4 2024-09-17T16:42:06.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.283+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:42:06.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.295+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94c01e53:::benchmark_data_smithi165_34272_object2849:head, will try copies on 0,4 2024-09-17T16:42:06.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.321+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ee419ed:::benchmark_data_smithi165_34272_object1790:head, will try copies on 3,4 2024-09-17T16:42:06.323 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.321+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:42:06.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.322+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d69c638:::benchmark_data_smithi165_34272_object253:head, will try copies on 0,4 2024-09-17T16:42:06.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.339+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5318df3c:::benchmark_data_smithi165_34272_object4034:head, will try copies on 3,4 2024-09-17T16:42:06.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.345+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68dcef85:::benchmark_data_smithi165_34272_object4511:head, will try copies on 3,4 2024-09-17T16:42:06.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.345+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf5aa2e7:::benchmark_data_smithi165_34272_object4101:head, will try copies on 2,3 2024-09-17T16:42:06.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.369+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:42:06.371 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.369+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:42:06.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.385+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:42:06.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.393+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:42:06.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.441+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:42:06.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.446+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:42:06.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.447+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b165e0ca:::benchmark_data_smithi165_34272_object314:head, will try copies on 2,3 2024-09-17T16:42:06.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.461+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f47dbc:::benchmark_data_smithi165_34272_object1188:head, will try copies on 3,4 2024-09-17T16:42:06.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.466+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:42:06.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.472+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:42:06.478 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.476+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91a66c09:::benchmark_data_smithi165_34272_object2960:head, will try copies on 0,4 2024-09-17T16:42:06.496 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.494+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:42:06.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.518+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:42:06.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.526+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:42:06.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.536+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:42:06.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.562+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:42:06.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.573+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c76be48:::benchmark_data_smithi165_34272_object1452:head, will try copies on 3,4 2024-09-17T16:42:06.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.591+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:42:06.594 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.592+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:42:06.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.598+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:912214a2:::benchmark_data_smithi165_34272_object3938:head, will try copies on 0,4 2024-09-17T16:42:06.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.609+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:42:06.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.616+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:42:06.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.623+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:42:06.629 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.627+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:42:06.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.657+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f4287eb:::benchmark_data_smithi165_34272_object832:head, will try copies on 0,4 2024-09-17T16:42:06.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.671+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:42:06.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.684+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b77078b:::benchmark_data_smithi165_34272_object2176:head, will try copies on 0,4 2024-09-17T16:42:06.687 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.685+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67f19f51:::benchmark_data_smithi165_34272_object3242:head, will try copies on 3,4 2024-09-17T16:42:06.696 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.694+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:42:06.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.711+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd0f324:::benchmark_data_smithi165_34272_object2994:head, will try copies on 2,3 2024-09-17T16:42:06.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.731+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:42:06.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.732+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:42:06.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.733+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6afe8885:::benchmark_data_smithi165_34272_object4132:head, will try copies on 3,4 2024-09-17T16:42:06.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.741+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf0ea3e4:::benchmark_data_smithi165_34272_object507:head, will try copies on 2,3 2024-09-17T16:42:06.766 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.763+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ea5c05:::benchmark_data_smithi165_34272_object2929:head, will try copies on 0,4 2024-09-17T16:42:06.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 343 16 4640031 4640015 845.407 793.312 0.000564306 0.00117212 2024-09-17T16:42:06.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.771+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:42:06.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.779+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:42:06.788 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.785+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:42:06.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.809+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9055f4ad:::benchmark_data_smithi165_34272_object3177:head, will try copies on 0,4 2024-09-17T16:42:06.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.810+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:42:06.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.822+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:42:06.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.844+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:42:06.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.845+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:42:06.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.861+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:42:06.894 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.891+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:42:06.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.908+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:42:06.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.918+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:42:06.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.928+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:42:06.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.938+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:42:06.948 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.946+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69919b8a:::benchmark_data_smithi165_34272_object1010:head, will try copies on 3,4 2024-09-17T16:42:06.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.953+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a1e8b92:::benchmark_data_smithi165_34272_object3658:head, will try copies on 0,4 2024-09-17T16:42:06.959 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.957+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:42:06.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.964+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:42:06.969 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:06.966+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:42:07.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.008+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:42:07.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.027+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:42:07.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.038+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:42:07.046 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.044+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bf443e:::benchmark_data_smithi165_34272_object1025:head, will try copies on 3,4 2024-09-17T16:42:07.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.063+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76dcbd7:::benchmark_data_smithi165_34272_object2916:head, will try copies on 2,3 2024-09-17T16:42:07.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.071+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56d62a59:::benchmark_data_smithi165_34272_object1374:head, will try copies on 3,4 2024-09-17T16:42:07.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.077+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:42:07.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.096+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4431b21:::benchmark_data_smithi165_34272_object3355:head, will try copies on 2,3 2024-09-17T16:42:07.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.110+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:42:07.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.144+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:42:07.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.146+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fd000eb:::benchmark_data_smithi165_34272_object2894:head, will try copies on 0,4 2024-09-17T16:42:07.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.154+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55a51edb:::benchmark_data_smithi165_34272_object3192:head, will try copies on 3,4 2024-09-17T16:42:07.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.163+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:42:07.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.184+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21b17ade:::benchmark_data_smithi165_34272_object4350:head, will try copies on 0,4 2024-09-17T16:42:07.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.185+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e4d35b2:::benchmark_data_smithi165_34272_object917:head, will try copies on 3,4 2024-09-17T16:42:07.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.197+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:42:07.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.214+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:42:07.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.221+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a0d8dc1:::benchmark_data_smithi165_34272_object844:head, will try copies on 3,4 2024-09-17T16:42:07.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.224+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b43c1850:::benchmark_data_smithi165_34272_object2430:head, will try copies on 2,3 2024-09-17T16:42:07.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.224+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dcffac6:::benchmark_data_smithi165_34272_object3801:head, will try copies on 3,4 2024-09-17T16:42:07.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.233+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:42:07.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.265+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dab6be:::benchmark_data_smithi165_34272_object2048:head, will try copies on 3,4 2024-09-17T16:42:07.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.267+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfc719fc:::benchmark_data_smithi165_34272_object3078:head, will try copies on 2,3 2024-09-17T16:42:07.273 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.271+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:42:07.295 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.293+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:42:07.304 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.302+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:42:07.312 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.309+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:42:07.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.320+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:42:07.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.335+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:42:07.338 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.335+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:42:07.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.344+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:42:07.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.363+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:42:07.372 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.369+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:42:07.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.378+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:42:07.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.390+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:42:07.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.398+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:42:07.421 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.419+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:42:07.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.434+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ee9f5e6:::benchmark_data_smithi165_34272_object3539:head, will try copies on 0,4 2024-09-17T16:42:07.453 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.451+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66408761:::benchmark_data_smithi165_34272_object2036:head, will try copies on 3,4 2024-09-17T16:42:07.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.463+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:42:07.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.489+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:42:07.497 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.494+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5baa64b6:::benchmark_data_smithi165_34272_object164:head, will try copies on 3,4 2024-09-17T16:42:07.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.497+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23777467:::benchmark_data_smithi165_34272_object2064:head, will try copies on 0,4 2024-09-17T16:42:07.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.511+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9658f083:::benchmark_data_smithi165_34272_object1231:head, will try copies on 0,4 2024-09-17T16:42:07.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.527+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b46aa83:::benchmark_data_smithi165_34272_object210:head, will try copies on 0,4 2024-09-17T16:42:07.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.535+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:42:07.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.554+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:42:07.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.558+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f40ff9:::benchmark_data_smithi165_34272_object3666:head, will try copies on 0,4 2024-09-17T16:42:07.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.560+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadee43:::benchmark_data_smithi165_34272_object2418:head, will try copies on 3,4 2024-09-17T16:42:07.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.572+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:42:07.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.583+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:216ed89a:::benchmark_data_smithi165_34272_object2712:head, will try copies on 0,4 2024-09-17T16:42:07.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.584+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:42:07.622 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.620+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:42:07.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.622+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bb664f2:::benchmark_data_smithi165_34272_object1729:head, will try copies on 0,4 2024-09-17T16:42:07.626 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.624+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:42:07.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.639+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5713ce26:::benchmark_data_smithi165_34272_object3755:head, will try copies on 3,4 2024-09-17T16:42:07.645 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.642+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:42:07.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.653+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:42:07.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.662+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:42:07.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.666+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:42:07.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.672+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:42:07.704 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.701+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:42:07.707 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.705+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:42:07.720 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.718+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:42:07.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.746+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:42:07.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 344 15 4653877 4653862 845.465 865.438 0.00080799 0.00117204 2024-09-17T16:42:07.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.771+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a08de5:::benchmark_data_smithi165_34272_object1603:head, will try copies on 3,4 2024-09-17T16:42:07.773 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.771+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:42:07.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.783+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:650b2d4e:::benchmark_data_smithi165_34272_object2462:head, will try copies on 3,4 2024-09-17T16:42:07.798 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.796+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:42:07.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.810+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:42:07.828 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.825+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:42:07.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.834+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:590f0be2:::benchmark_data_smithi165_34272_object70:head, will try copies on 3,4 2024-09-17T16:42:07.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.845+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:42:07.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.868+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:42:07.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.876+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:42:07.901 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.898+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:42:07.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.914+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:42:07.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.915+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:42:07.943 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.940+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:42:07.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.943+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a8c9b77:::benchmark_data_smithi165_34272_object1091:head, will try copies on 0,4 2024-09-17T16:42:07.947 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.944+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7de2dd1:::benchmark_data_smithi165_34272_object3692:head, will try copies on 2,3 2024-09-17T16:42:07.958 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.956+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:640c4291:::benchmark_data_smithi165_34272_object488:head, will try copies on 3,4 2024-09-17T16:42:07.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.973+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc5f621:::benchmark_data_smithi165_34272_object4057:head, will try copies on 0,4 2024-09-17T16:42:07.991 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:07.989+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:42:08.010 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.008+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:42:08.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.021+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:42:08.024 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.022+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:42:08.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.027+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:42:08.062 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.060+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:42:08.063 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.061+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:626cf213:::benchmark_data_smithi165_34272_object3526:head, will try copies on 3,4 2024-09-17T16:42:08.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.080+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0868a6c:::benchmark_data_smithi165_34272_object1512:head, will try copies on 2,3 2024-09-17T16:42:08.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.091+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e23dac7:::benchmark_data_smithi165_34272_object2913:head, will try copies on 0,4 2024-09-17T16:42:08.097 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.095+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:42:08.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.105+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:42:08.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.131+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:900fbe04:::benchmark_data_smithi165_34272_object3640:head, will try copies on 0,4 2024-09-17T16:42:08.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.141+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:42:08.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.144+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:42:08.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.153+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:42:08.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.158+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2474440c:::benchmark_data_smithi165_34272_object2440:head, will try copies on 0,4 2024-09-17T16:42:08.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.159+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:42:08.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.233+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:42:08.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.254+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c28cf07:::benchmark_data_smithi165_34272_object2391:head, will try copies on 3,4 2024-09-17T16:42:08.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.281+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644d86e6:::benchmark_data_smithi165_34272_object4312:head, will try copies on 3,4 2024-09-17T16:42:08.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.281+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:42:08.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.296+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:42:08.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.307+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2beba019:::benchmark_data_smithi165_34272_object2602:head, will try copies on 0,4 2024-09-17T16:42:08.332 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.330+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6012544b:::benchmark_data_smithi165_34272_object2270:head, will try copies on 3,4 2024-09-17T16:42:08.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.339+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b27f65c3:::benchmark_data_smithi165_34272_object2757:head, will try copies on 2,3 2024-09-17T16:42:08.350 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.348+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:42:08.356 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.354+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29401751:::benchmark_data_smithi165_34272_object2364:head, will try copies on 0,4 2024-09-17T16:42:08.358 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.356+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af59f6d:::benchmark_data_smithi165_34272_object3778:head, will try copies on 3,4 2024-09-17T16:42:08.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.363+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b76bc910:::benchmark_data_smithi165_34272_object2724:head, will try copies on 2,3 2024-09-17T16:42:08.390 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6aa5ee5c:::benchmark_data_smithi165_34272_object2235:head, will try copies on 3,4 2024-09-17T16:42:08.391 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.389+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ad44da2:::benchmark_data_smithi165_34272_object4342:head, will try copies on 0,4 2024-09-17T16:42:08.401 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.399+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:42:08.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.408+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8542f5b:::benchmark_data_smithi165_34272_object1323:head, will try copies on 2,3 2024-09-17T16:42:08.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.439+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:42:08.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.447+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5706f206:::benchmark_data_smithi165_34272_object1249:head, will try copies on 3,4 2024-09-17T16:42:08.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.451+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28f7ec80:::benchmark_data_smithi165_34272_object1430:head, will try copies on 0,4 2024-09-17T16:42:08.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.466+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d60c5e7:::benchmark_data_smithi165_34272_object4024:head, will try copies on 3,4 2024-09-17T16:42:08.469 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.467+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b962e0ca:::benchmark_data_smithi165_34272_object1569:head, will try copies on 2,3 2024-09-17T16:42:08.483 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.481+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e53b712:::benchmark_data_smithi165_34272_object1829:head, will try copies on 0,4 2024-09-17T16:42:08.507 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.504+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28fc1739:::benchmark_data_smithi165_34272_object3823:head, will try copies on 0,4 2024-09-17T16:42:08.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.524+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58db4d36:::benchmark_data_smithi165_34272_object3687:head, will try copies on 3,4 2024-09-17T16:42:08.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.535+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9697b013:::benchmark_data_smithi165_34272_object3085:head, will try copies on 0,4 2024-09-17T16:42:08.541 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.539+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c3d424:::benchmark_data_smithi165_34272_object2677:head, will try copies on 3,4 2024-09-17T16:42:08.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.557+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:42:08.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.599+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91030fe0:::benchmark_data_smithi165_34272_object1592:head, will try copies on 0,4 2024-09-17T16:42:08.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.607+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b16b43c:::benchmark_data_smithi165_34272_object978:head, will try copies on 3,4 2024-09-17T16:42:08.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.623+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6adcbbf5:::benchmark_data_smithi165_34272_object3839:head, will try copies on 3,4 2024-09-17T16:42:08.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.639+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:42:08.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.640+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:42:08.653 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.650+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:42:08.658 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.656+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd4f7117:::benchmark_data_smithi165_34272_object1048:head, will try copies on 2,3 2024-09-17T16:42:08.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.664+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:42:08.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.668+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b9c89:::benchmark_data_smithi165_34272_object4180:head, will try copies on 3,4 2024-09-17T16:42:08.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.679+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b470e72c:::benchmark_data_smithi165_34272_object1280:head, will try copies on 2,3 2024-09-17T16:42:08.711 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.709+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:42:08.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.711+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:42:08.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.731+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b7f82c41:::benchmark_data_smithi165_34272_object2427:head, will try copies on 2,3 2024-09-17T16:42:08.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.762+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a2e1d52:::benchmark_data_smithi165_34272_object3273:head, will try copies on 3,4 2024-09-17T16:42:08.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 345 15 4667092 4667077 845.408 825.938 0.000946462 0.00117212 2024-09-17T16:42:08.780 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.777+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:42:08.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.781+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:42:08.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.790+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:42:08.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.803+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:42:08.821 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.819+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5370840d:::benchmark_data_smithi165_34272_object391:head, will try copies on 3,4 2024-09-17T16:42:08.829 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.827+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67b5e5be:::benchmark_data_smithi165_34272_object2597:head, will try copies on 3,4 2024-09-17T16:42:08.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.838+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:42:08.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.842+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:42:08.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.851+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:42:08.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.859+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9188ef99:::benchmark_data_smithi165_34272_object4478:head, will try copies on 0,4 2024-09-17T16:42:08.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.861+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb48cfb:::benchmark_data_smithi165_34272_object2827:head, will try copies on 3,4 2024-09-17T16:42:08.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.885+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:42:08.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.896+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4b8de61:::benchmark_data_smithi165_34272_object4298:head, will try copies on 2,3 2024-09-17T16:42:08.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.909+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:42:08.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.931+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c781da1:::benchmark_data_smithi165_34272_object2793:head, will try copies on 0,4 2024-09-17T16:42:08.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.937+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:42:08.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.943+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:42:08.964 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.962+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a258c33:::benchmark_data_smithi165_34272_object137:head, will try copies on 3,4 2024-09-17T16:42:08.972 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.969+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad9493b:::benchmark_data_smithi165_34272_object4467:head, will try copies on 0,4 2024-09-17T16:42:08.984 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.982+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b754f306:::benchmark_data_smithi165_34272_object3014:head, will try copies on 2,3 2024-09-17T16:42:08.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.992+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:42:08.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:08.996+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:42:09.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.005+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5a6e7b1:::benchmark_data_smithi165_34272_object2000:head, will try copies on 2,3 2024-09-17T16:42:09.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.014+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:42:09.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.021+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53e0e015:::benchmark_data_smithi165_34272_object1470:head, will try copies on 3,4 2024-09-17T16:42:09.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.027+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62b4d571:::benchmark_data_smithi165_34272_object4302:head, will try copies on 3,4 2024-09-17T16:42:09.036 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.034+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:42:09.061 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.058+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:42:09.083 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.080+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:42:09.094 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.092+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:42:09.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.094+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ddface:::benchmark_data_smithi165_34272_object241:head, will try copies on 0,4 2024-09-17T16:42:09.103 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.101+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:262a050f:::benchmark_data_smithi165_34272_object589:head, will try copies on 0,4 2024-09-17T16:42:09.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.106+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb265f7e:::benchmark_data_smithi165_34272_object1881:head, will try copies on 2,3 2024-09-17T16:42:09.133 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.131+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526c82ab:::benchmark_data_smithi165_34272_object2311:head, will try copies on 3,4 2024-09-17T16:42:09.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.134+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:42:09.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.146+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:42:09.163 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.160+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:42:09.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.172+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:42:09.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.185+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6687619b:::benchmark_data_smithi165_34272_object4438:head, will try copies on 3,4 2024-09-17T16:42:09.197 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.195+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:42:09.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.199+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:42:09.221 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.219+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2721743d:::benchmark_data_smithi165_34272_object1967:head, will try copies on 0,4 2024-09-17T16:42:09.222 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.220+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:42:09.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.224+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cd9c8f7:::benchmark_data_smithi165_34272_object173:head, will try copies on 3,4 2024-09-17T16:42:09.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.226+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:548e108f:::benchmark_data_smithi165_34272_object1716:head, will try copies on 3,4 2024-09-17T16:42:09.249 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.246+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20fd8c69:::benchmark_data_smithi165_34272_object1529:head, will try copies on 0,4 2024-09-17T16:42:09.263 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.261+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dfb4cb4:::benchmark_data_smithi165_34272_object2811:head, will try copies on 3,4 2024-09-17T16:42:09.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.280+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:42:09.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.290+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:42:09.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.299+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d5ec711:::benchmark_data_smithi165_34272_object387:head, will try copies on 3,4 2024-09-17T16:42:09.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.300+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ca972d6:::benchmark_data_smithi165_34272_object3900:head, will try copies on 3,4 2024-09-17T16:42:09.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.300+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:42:09.313 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.311+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be93416d:::benchmark_data_smithi165_34272_object4125:head, will try copies on 2,3 2024-09-17T16:42:09.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.337+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56df9a0c:::benchmark_data_smithi165_34272_object3122:head, will try copies on 3,4 2024-09-17T16:42:09.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.341+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f51bec:::benchmark_data_smithi165_34272_object705:head, will try copies on 0,4 2024-09-17T16:42:09.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.360+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:268cc01c:::benchmark_data_smithi165_34272_object3906:head, will try copies on 0,4 2024-09-17T16:42:09.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.366+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:42:09.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.374+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b915b5a7:::benchmark_data_smithi165_34272_object1803:head, will try copies on 2,3 2024-09-17T16:42:09.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.398+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:42:09.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eac2589:::benchmark_data_smithi165_34272_object2693:head, will try copies on 3,4 2024-09-17T16:42:09.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.419+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:575e8b85:::benchmark_data_smithi165_34272_object2540:head, will try copies on 3,4 2024-09-17T16:42:09.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.440+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:686585bd:::benchmark_data_smithi165_34272_object1627:head, will try copies on 3,4 2024-09-17T16:42:09.452 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.450+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:42:09.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.454+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dd95b5e:::benchmark_data_smithi165_34272_object1184:head, will try copies on 3,4 2024-09-17T16:42:09.466 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.463+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be7b00be:::benchmark_data_smithi165_34272_object4253:head, will try copies on 2,3 2024-09-17T16:42:09.467 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.464+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:42:09.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.479+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:42:09.494 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.492+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:509fd1a0:::benchmark_data_smithi165_34272_object2858:head, will try copies on 3,4 2024-09-17T16:42:09.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.506+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf777129:::benchmark_data_smithi165_34272_object1370:head, will try copies on 2,3 2024-09-17T16:42:09.520 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.518+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:42:09.522 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.520+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:42:09.528 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.526+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:42:09.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.552+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:976042e9:::benchmark_data_smithi165_34272_object3405:head, will try copies on 0,4 2024-09-17T16:42:09.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.555+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:253c52e7:::benchmark_data_smithi165_34272_object2703:head, will try copies on 0,4 2024-09-17T16:42:09.573 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.571+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:42:09.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.588+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:42:09.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.605+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:42:09.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.630+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89c711b:::benchmark_data_smithi165_34272_object3214:head, will try copies on 2,3 2024-09-17T16:42:09.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.647+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:42:09.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.670+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eb20081:::benchmark_data_smithi165_34272_object3894:head, will try copies on 3,4 2024-09-17T16:42:09.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.671+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:42:09.682 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.680+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:42:09.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.695+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eff0fa:::benchmark_data_smithi165_34272_object2321:head, will try copies on 3,4 2024-09-17T16:42:09.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.696+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b44f37b6:::benchmark_data_smithi165_34272_object2791:head, will try copies on 2,3 2024-09-17T16:42:09.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.699+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f121846:::benchmark_data_smithi165_34272_object4534:head, will try copies on 0,4 2024-09-17T16:42:09.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.730+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:42:09.735 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.733+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:42:09.744 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.741+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:42:09.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.755+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:655505ab:::benchmark_data_smithi165_34272_object71:head, will try copies on 3,4 2024-09-17T16:42:09.764 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.761+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:42:09.767 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.765+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:42:09.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 346 15 4680361 4680346 845.361 829.312 0.000440913 0.00117218 2024-09-17T16:42:09.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.777+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58b346dd:::benchmark_data_smithi165_34272_object3450:head, will try copies on 3,4 2024-09-17T16:42:09.805 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.802+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6908e668:::benchmark_data_smithi165_34272_object2995:head, will try copies on 3,4 2024-09-17T16:42:09.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.809+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:42:09.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.830+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91004882:::benchmark_data_smithi165_34272_object747:head, will try copies on 0,4 2024-09-17T16:42:09.847 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.845+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b0de6e:::benchmark_data_smithi165_34272_object2055:head, will try copies on 0,4 2024-09-17T16:42:09.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.866+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:42:09.883 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.880+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:42:09.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.896+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e0de27c:::benchmark_data_smithi165_34272_object2425:head, will try copies on 3,4 2024-09-17T16:42:09.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.898+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:42:09.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.907+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:42:09.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.929+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:42:09.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.929+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e9c11b7:::benchmark_data_smithi165_34272_object1415:head, will try copies on 0,4 2024-09-17T16:42:09.938 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.936+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:42:09.956 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.954+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:42:09.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.954+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:42:09.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.973+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5055a85d:::benchmark_data_smithi165_34272_object2576:head, will try copies on 3,4 2024-09-17T16:42:09.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.980+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:42:09.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:09.997+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:42:10.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.000+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:42:10.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.007+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be4d84aa:::benchmark_data_smithi165_34272_object4305:head, will try copies on 2,3 2024-09-17T16:42:10.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.026+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9147d566:::benchmark_data_smithi165_34272_object2772:head, will try copies on 0,4 2024-09-17T16:42:10.030 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.027+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:42:10.042 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.040+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:42:10.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.042+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:272d3218:::benchmark_data_smithi165_34272_object397:head, will try copies on 0,4 2024-09-17T16:42:10.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.058+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:42:10.084 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.082+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:42:10.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.087+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:42:10.096 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.094+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:42:10.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.106+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59c6e869:::benchmark_data_smithi165_34272_object2059:head, will try copies on 3,4 2024-09-17T16:42:10.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.140+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:42:10.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.144+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:42:10.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.153+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:42:10.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.153+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb17fc2d:::benchmark_data_smithi165_34272_object2748:head, will try copies on 2,3 2024-09-17T16:42:10.161 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.158+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:42:10.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.199+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53ab8a96:::benchmark_data_smithi165_34272_object2437:head, will try copies on 3,4 2024-09-17T16:42:10.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.204+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b286cd0e:::benchmark_data_smithi165_34272_object2971:head, will try copies on 2,3 2024-09-17T16:42:10.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.228+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91aca2d3:::benchmark_data_smithi165_34272_object4254:head, will try copies on 0,4 2024-09-17T16:42:10.231 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.229+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfcf4647:::benchmark_data_smithi165_34272_object4464:head, will try copies on 2,3 2024-09-17T16:42:10.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.246+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c635726:::benchmark_data_smithi165_34272_object2634:head, will try copies on 3,4 2024-09-17T16:42:10.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.259+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:960abfd3:::benchmark_data_smithi165_34272_object388:head, will try copies on 0,4 2024-09-17T16:42:10.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.272+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c1bb6a:::benchmark_data_smithi165_34272_object2790:head, will try copies on 3,4 2024-09-17T16:42:10.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.278+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:42:10.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.279+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b579c907:::benchmark_data_smithi165_34272_object1769:head, will try copies on 2,3 2024-09-17T16:42:10.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.280+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:42:10.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.321+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3203ded:::benchmark_data_smithi165_34272_object2817:head, will try copies on 2,3 2024-09-17T16:42:10.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.327+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:42:10.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.331+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b007887:::benchmark_data_smithi165_34272_object1768:head, will try copies on 0,4 2024-09-17T16:42:10.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.338+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba8d825b:::benchmark_data_smithi165_34272_object2760:head, will try copies on 2,3 2024-09-17T16:42:10.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.341+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:42:10.354 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.352+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:42:10.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.360+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62361308:::benchmark_data_smithi165_34272_object3062:head, will try copies on 3,4 2024-09-17T16:42:10.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.379+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d3de82b:::benchmark_data_smithi165_34272_object751:head, will try copies on 0,4 2024-09-17T16:42:10.382 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.379+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:42:10.384 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.382+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2decbd74:::benchmark_data_smithi165_34272_object3227:head, will try copies on 0,4 2024-09-17T16:42:10.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.392+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:693bf8f7:::benchmark_data_smithi165_34272_object4414:head, will try copies on 3,4 2024-09-17T16:42:10.400 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.398+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:42:10.417 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.415+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea80143:::benchmark_data_smithi165_34272_object1866:head, will try copies on 0,4 2024-09-17T16:42:10.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.420+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:42:10.445 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.442+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad04a3:::benchmark_data_smithi165_34272_object1811:head, will try copies on 3,4 2024-09-17T16:42:10.473 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.471+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:42:10.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.472+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:42:10.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.493+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b763477:::benchmark_data_smithi165_34272_object1403:head, will try copies on 0,4 2024-09-17T16:42:10.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.500+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:42:10.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.516+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:42:10.519 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.517+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:42:10.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.548+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9e90bed:::benchmark_data_smithi165_34272_object2972:head, will try copies on 2,3 2024-09-17T16:42:10.556 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.554+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:673a3002:::benchmark_data_smithi165_34272_object2816:head, will try copies on 3,4 2024-09-17T16:42:10.576 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.574+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:42:10.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.601+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:42:10.607 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.604+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:42:10.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.611+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:42:10.631 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.629+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63143390:::benchmark_data_smithi165_34272_object2324:head, will try copies on 3,4 2024-09-17T16:42:10.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.630+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:42:10.671 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.668+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:42:10.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.673+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:42:10.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.696+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:42:10.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.714+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9edb39fb:::benchmark_data_smithi165_34272_object521:head, will try copies on 0,4 2024-09-17T16:42:10.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.728+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:42:10.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.730+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfeefae:::benchmark_data_smithi165_34272_object754:head, will try copies on 3,4 2024-09-17T16:42:10.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.741+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:42:10.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.749+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:42:10.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.756+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cead0de:::benchmark_data_smithi165_34272_object2493:head, will try copies on 3,4 2024-09-17T16:42:10.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 347 16 4694205 4694189 845.418 865.188 0.00382117 0.0011721 2024-09-17T16:42:10.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.783+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:42:10.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.783+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f130e73:::benchmark_data_smithi165_34272_object4531:head, will try copies on 0,4 2024-09-17T16:42:10.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.788+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd2acf71:::benchmark_data_smithi165_34272_object3920:head, will try copies on 2,3 2024-09-17T16:42:10.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.789+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5596aa2c:::benchmark_data_smithi165_34272_object926:head, will try copies on 3,4 2024-09-17T16:42:10.824 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.822+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:42:10.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.829+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:42:10.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.834+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:42:10.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.835+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:42:10.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.853+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:42:10.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.856+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:42:10.870 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.867+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d538a77:::benchmark_data_smithi165_34272_object2610:head, will try copies on 3,4 2024-09-17T16:42:10.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.879+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:42:10.895 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.892+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:42:10.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.896+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cdddc5:::benchmark_data_smithi165_34272_object877:head, will try copies on 2,3 2024-09-17T16:42:10.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.903+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b1f1a70:::benchmark_data_smithi165_34272_object3905:head, will try copies on 0,4 2024-09-17T16:42:10.917 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.915+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6592d2f4:::benchmark_data_smithi165_34272_object2365:head, will try copies on 3,4 2024-09-17T16:42:10.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.921+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:915a8e16:::benchmark_data_smithi165_34272_object3429:head, will try copies on 0,4 2024-09-17T16:42:10.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.931+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:42:10.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.950+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91c45a57:::benchmark_data_smithi165_34272_object1106:head, will try copies on 0,4 2024-09-17T16:42:10.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.957+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:42:10.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.957+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:42:10.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:10.991+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccb4166:::benchmark_data_smithi165_34272_object2957:head, will try copies on 3,4 2024-09-17T16:42:11.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.009+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:42:11.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.015+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:42:11.018 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.016+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:42:11.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.035+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2800d447:::benchmark_data_smithi165_34272_object750:head, will try copies on 0,4 2024-09-17T16:42:11.038 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.036+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8715c7:::benchmark_data_smithi165_34272_object1196:head, will try copies on 3,4 2024-09-17T16:42:11.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.058+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80f0ad9:::benchmark_data_smithi165_34272_object1330:head, will try copies on 2,3 2024-09-17T16:42:11.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.070+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59181a6e:::benchmark_data_smithi165_34272_object2125:head, will try copies on 3,4 2024-09-17T16:42:11.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.071+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:42:11.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.077+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:42:11.105 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.102+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5102d216:::benchmark_data_smithi165_34272_object2705:head, will try copies on 3,4 2024-09-17T16:42:11.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.110+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b884c518:::benchmark_data_smithi165_34272_object3818:head, will try copies on 2,3 2024-09-17T16:42:11.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.125+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:42:11.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.126+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:42:11.132 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.130+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf281f8:::benchmark_data_smithi165_34272_object3306:head, will try copies on 3,4 2024-09-17T16:42:11.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.144+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95052885:::benchmark_data_smithi165_34272_object2565:head, will try copies on 0,4 2024-09-17T16:42:11.159 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.157+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cd0c4d3:::benchmark_data_smithi165_34272_object129:head, will try copies on 3,4 2024-09-17T16:42:11.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.172+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c657359:::benchmark_data_smithi165_34272_object2160:head, will try copies on 3,4 2024-09-17T16:42:11.184 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.182+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:42:11.186 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.184+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:42:11.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.218+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd53a2a6:::benchmark_data_smithi165_34272_object785:head, will try copies on 2,3 2024-09-17T16:42:11.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.224+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:42:11.227 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.225+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:42:11.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.243+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282a489d:::benchmark_data_smithi165_34272_object2571:head, will try copies on 0,4 2024-09-17T16:42:11.245 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.243+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc44d4c3:::benchmark_data_smithi165_34272_object2181:head, will try copies on 2,3 2024-09-17T16:42:11.246 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.244+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:42:11.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.279+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3276801:::benchmark_data_smithi165_34272_object317:head, will try copies on 2,3 2024-09-17T16:42:11.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.295+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba6a8dab:::benchmark_data_smithi165_34272_object116:head, will try copies on 2,3 2024-09-17T16:42:11.298 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.295+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:42:11.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.300+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:42:11.305 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.303+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:42:11.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.319+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8053fe0:::benchmark_data_smithi165_34272_object4048:head, will try copies on 2,3 2024-09-17T16:42:11.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.359+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b36d3db9:::benchmark_data_smithi165_34272_object3315:head, will try copies on 2,3 2024-09-17T16:42:11.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.359+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66e3d6a0:::benchmark_data_smithi165_34272_object3156:head, will try copies on 3,4 2024-09-17T16:42:11.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.376+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:42:11.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.379+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9d9263:::benchmark_data_smithi165_34272_object232:head, will try copies on 0,4 2024-09-17T16:42:11.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.387+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:42:11.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.390+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:42:11.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.411+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:42:11.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.441+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:42:11.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.447+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:42:11.450 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.448+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:42:11.454 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.452+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:42:11.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.500+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:42:11.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.521+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:42:11.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.522+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55cb39d5:::benchmark_data_smithi165_34272_object3067:head, will try copies on 3,4 2024-09-17T16:42:11.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.559+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:42:11.565 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.563+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26a75eee:::benchmark_data_smithi165_34272_object1398:head, will try copies on 0,4 2024-09-17T16:42:11.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.573+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:636638dd:::benchmark_data_smithi165_34272_object980:head, will try copies on 3,4 2024-09-17T16:42:11.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.591+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:42:11.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.607+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:42:11.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.610+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:42:11.614 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.612+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e586116:::benchmark_data_smithi165_34272_object2956:head, will try copies on 3,4 2024-09-17T16:42:11.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.644+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:42:11.652 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.649+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bebe3d:::benchmark_data_smithi165_34272_object3438:head, will try copies on 0,4 2024-09-17T16:42:11.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.677+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5285a5d8:::benchmark_data_smithi165_34272_object3139:head, will try copies on 3,4 2024-09-17T16:42:11.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.688+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3c4a954:::benchmark_data_smithi165_34272_object3398:head, will try copies on 2,3 2024-09-17T16:42:11.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.697+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:42:11.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.701+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:42:11.706 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.704+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:42:11.714 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.712+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:42:11.729 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.727+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:42:11.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.745+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:42:11.757 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.755+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94ee3eb2:::benchmark_data_smithi165_34272_object2560:head, will try copies on 0,4 2024-09-17T16:42:11.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 348 16 4708273 4708257 845.515 879.25 0.000581302 0.00117197 2024-09-17T16:42:11.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.770+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:42:11.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.784+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5484edec:::benchmark_data_smithi165_34272_object2655:head, will try copies on 3,4 2024-09-17T16:42:11.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.788+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:42:11.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.793+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:42:11.811 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.808+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:42:11.826 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.824+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b96c650:::benchmark_data_smithi165_34272_object950:head, will try copies on 0,4 2024-09-17T16:42:11.834 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.832+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:42:11.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.846+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:42:11.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.857+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:42:11.866 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.864+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:42:11.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.879+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:42:11.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.891+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:42:11.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.898+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:42:11.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.908+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:42:11.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.919+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:42:11.931 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.929+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2a15ad71:::benchmark_data_smithi165_34272_object4188:head, will try copies on 0,4 2024-09-17T16:42:11.939 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.937+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ebe1986:::benchmark_data_smithi165_34272_object2983:head, will try copies on 3,4 2024-09-17T16:42:11.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.938+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:42:11.949 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.947+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:42:11.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.968+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:42:11.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.979+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b8370c9:::benchmark_data_smithi165_34272_object3345:head, will try copies on 0,4 2024-09-17T16:42:11.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:11.996+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:42:12.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.029+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:42:12.032 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.030+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b52cfafa:::benchmark_data_smithi165_34272_object4393:head, will try copies on 2,3 2024-09-17T16:42:12.040 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.037+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61158b48:::benchmark_data_smithi165_34272_object1707:head, will try copies on 3,4 2024-09-17T16:42:12.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.045+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:42:12.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.051+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:42:12.055 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.052+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:42:12.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.083+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:42:12.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.091+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:42:12.095 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.093+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf254e9:::benchmark_data_smithi165_34272_object3759:head, will try copies on 3,4 2024-09-17T16:42:12.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.111+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ad84a56:::benchmark_data_smithi165_34272_object4000:head, will try copies on 0,4 2024-09-17T16:42:12.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.121+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:42:12.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.128+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:42:12.164 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.162+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd31de:::benchmark_data_smithi165_34272_object3642:head, will try copies on 2,3 2024-09-17T16:42:12.167 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.165+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:42:12.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.173+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b715bf:::benchmark_data_smithi165_34272_object4032:head, will try copies on 3,4 2024-09-17T16:42:12.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.178+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95f2dc9a:::benchmark_data_smithi165_34272_object360:head, will try copies on 0,4 2024-09-17T16:42:12.189 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.187+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:42:12.199 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.197+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:42:12.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.205+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:42:12.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.210+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66215e3f:::benchmark_data_smithi165_34272_object3237:head, will try copies on 3,4 2024-09-17T16:42:12.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.210+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e05a525:::benchmark_data_smithi165_34272_object3164:head, will try copies on 0,4 2024-09-17T16:42:12.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.224+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:200b1d96:::benchmark_data_smithi165_34272_object3057:head, will try copies on 0,4 2024-09-17T16:42:12.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.260+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:42:12.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.272+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9888b403:::benchmark_data_smithi165_34272_object267:head, will try copies on 0,4 2024-09-17T16:42:12.278 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.276+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:691c0832:::benchmark_data_smithi165_34272_object787:head, will try copies on 3,4 2024-09-17T16:42:12.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.316+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:42:12.322 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.320+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:42:12.327 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.325+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:42:12.349 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.346+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:42:12.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.359+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:42:12.387 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.384+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:42:12.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.387+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb9ac48:::benchmark_data_smithi165_34272_object3400:head, will try copies on 0,4 2024-09-17T16:42:12.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.391+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:277e017d:::benchmark_data_smithi165_34272_object3317:head, will try copies on 0,4 2024-09-17T16:42:12.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.407+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:42:12.410 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.407+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:42:12.422 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.420+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:42:12.442 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.439+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a96225:::benchmark_data_smithi165_34272_object858:head, will try copies on 0,4 2024-09-17T16:42:12.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.458+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63d9fe67:::benchmark_data_smithi165_34272_object484:head, will try copies on 3,4 2024-09-17T16:42:12.472 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.470+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:42:12.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.475+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:659933d4:::benchmark_data_smithi165_34272_object896:head, will try copies on 3,4 2024-09-17T16:42:12.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.486+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:42:12.493 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.490+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:42:12.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.506+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b40d9d5c:::benchmark_data_smithi165_34272_object3321:head, will try copies on 2,3 2024-09-17T16:42:12.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.512+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:42:12.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.522+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:923b4530:::benchmark_data_smithi165_34272_object4561:head, will try copies on 0,4 2024-09-17T16:42:12.535 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.532+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:42:12.540 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.537+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174bdd2:::benchmark_data_smithi165_34272_object3095:head, will try copies on 2,3 2024-09-17T16:42:12.550 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.547+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:657c18ce:::benchmark_data_smithi165_34272_object623:head, will try copies on 3,4 2024-09-17T16:42:12.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.550+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:42:12.553 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.550+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9930b555:::benchmark_data_smithi165_34272_object2784:head, will try copies on 0,4 2024-09-17T16:42:12.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.561+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:42:12.593 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.590+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60354c78:::benchmark_data_smithi165_34272_object4008:head, will try copies on 3,4 2024-09-17T16:42:12.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.593+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21bfa60e:::benchmark_data_smithi165_34272_object4089:head, will try copies on 0,4 2024-09-17T16:42:12.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.603+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9aa085d4:::benchmark_data_smithi165_34272_object696:head, will try copies on 0,4 2024-09-17T16:42:12.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.623+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:42:12.651 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.649+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f841dc:::benchmark_data_smithi165_34272_object3790:head, will try copies on 3,4 2024-09-17T16:42:12.669 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.667+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9b12ac9:::benchmark_data_smithi165_34272_object3173:head, will try copies on 2,3 2024-09-17T16:42:12.670 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.668+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:42:12.676 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.674+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:42:12.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.696+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:42:12.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.707+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:42:12.730 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.728+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07c7dce:::benchmark_data_smithi165_34272_object3072:head, will try copies on 2,3 2024-09-17T16:42:12.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.732+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e4be31e:::benchmark_data_smithi165_34272_object4073:head, will try copies on 0,4 2024-09-17T16:42:12.739 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.737+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:42:12.743 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.741+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:42:12.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.757+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94863fff:::benchmark_data_smithi165_34272_object1315:head, will try copies on 0,4 2024-09-17T16:42:12.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 349 16 4722130 4722114 845.574 866.062 0.00105639 0.00117188 2024-09-17T16:42:12.769 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.766+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b71ecf01:::benchmark_data_smithi165_34272_object1548:head, will try copies on 2,3 2024-09-17T16:42:12.771 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.769+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:42:12.799 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.797+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bf9cb37:::benchmark_data_smithi165_34272_object2362:head, will try copies on 3,4 2024-09-17T16:42:12.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.799+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:932105ea:::benchmark_data_smithi165_34272_object4233:head, will try copies on 0,4 2024-09-17T16:42:12.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.805+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:42:12.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.828+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:42:12.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.833+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:42:12.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.842+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:42:12.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.850+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:228d8105:::benchmark_data_smithi165_34272_object2332:head, will try copies on 0,4 2024-09-17T16:42:12.853 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.851+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595604d0:::benchmark_data_smithi165_34272_object88:head, will try copies on 3,4 2024-09-17T16:42:12.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.872+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:42:12.892 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.889+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:42:12.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.890+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:42:12.911 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.909+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5f2ba4:::benchmark_data_smithi165_34272_object3743:head, will try copies on 3,4 2024-09-17T16:42:12.927 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.925+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b282924b:::benchmark_data_smithi165_34272_object1810:head, will try copies on 2,3 2024-09-17T16:42:12.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.930+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99cd4823:::benchmark_data_smithi165_34272_object456:head, will try copies on 0,4 2024-09-17T16:42:12.945 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.943+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5984d95a:::benchmark_data_smithi165_34272_object1983:head, will try copies on 3,4 2024-09-17T16:42:12.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.963+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b25081c:::benchmark_data_smithi165_34272_object3560:head, will try copies on 0,4 2024-09-17T16:42:12.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.963+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:42:12.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.973+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:42:12.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:12.979+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:42:13.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.008+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f50bd48:::benchmark_data_smithi165_34272_object1282:head, will try copies on 0,4 2024-09-17T16:42:13.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.009+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:42:13.033 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.031+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:42:13.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.039+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66acf8c6:::benchmark_data_smithi165_34272_object3508:head, will try copies on 3,4 2024-09-17T16:42:13.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.043+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b03dee42:::benchmark_data_smithi165_34272_object1071:head, will try copies on 2,3 2024-09-17T16:42:13.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.076+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90fe75d4:::benchmark_data_smithi165_34272_object4548:head, will try copies on 0,4 2024-09-17T16:42:13.080 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.078+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:42:13.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.090+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6359e9c9:::benchmark_data_smithi165_34272_object3576:head, will try copies on 3,4 2024-09-17T16:42:13.098 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.096+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:42:13.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.118+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fd35dd6:::benchmark_data_smithi165_34272_object3622:head, will try copies on 0,4 2024-09-17T16:42:13.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.118+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:42:13.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.132+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:42:13.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.140+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:42:13.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.154+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:42:13.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.166+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b456aae:::benchmark_data_smithi165_34272_object2527:head, will try copies on 0,4 2024-09-17T16:42:13.177 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.175+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b66beeed:::benchmark_data_smithi165_34272_object2142:head, will try copies on 2,3 2024-09-17T16:42:13.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.193+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d236793:::benchmark_data_smithi165_34272_object1773:head, will try copies on 3,4 2024-09-17T16:42:13.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.198+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a91cea:::benchmark_data_smithi165_34272_object1522:head, will try copies on 0,4 2024-09-17T16:42:13.218 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.216+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:42:13.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.233+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d1fd22:::benchmark_data_smithi165_34272_object3914:head, will try copies on 0,4 2024-09-17T16:42:13.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.241+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc806a0e:::benchmark_data_smithi165_34272_object3702:head, will try copies on 2,3 2024-09-17T16:42:13.266 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.264+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:42:13.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.279+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:42:13.286 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.284+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:42:13.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.285+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96636e8d:::benchmark_data_smithi165_34272_object3452:head, will try copies on 0,4 2024-09-17T16:42:13.297 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.294+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b183d346:::benchmark_data_smithi165_34272_object855:head, will try copies on 2,3 2024-09-17T16:42:13.309 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.307+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:42:13.318 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.315+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:42:13.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.327+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53a542b6:::benchmark_data_smithi165_34272_object31:head, will try copies on 3,4 2024-09-17T16:42:13.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.344+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b88ab1e0:::benchmark_data_smithi165_34272_object793:head, will try copies on 2,3 2024-09-17T16:42:13.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.360+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e13f323:::benchmark_data_smithi165_34272_object3562:head, will try copies on 0,4 2024-09-17T16:42:13.367 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.365+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8b1363:::benchmark_data_smithi165_34272_object1574:head, will try copies on 3,4 2024-09-17T16:42:13.370 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.368+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:42:13.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.391+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:beddfbf5:::benchmark_data_smithi165_34272_object1157:head, will try copies on 2,3 2024-09-17T16:42:13.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.396+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:970f8161:::benchmark_data_smithi165_34272_object4104:head, will try copies on 0,4 2024-09-17T16:42:13.405 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.403+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:42:13.412 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.409+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27123c32:::benchmark_data_smithi165_34272_object2566:head, will try copies on 0,4 2024-09-17T16:42:13.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.410+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3f89bf:::benchmark_data_smithi165_34272_object4526:head, will try copies on 3,4 2024-09-17T16:42:13.433 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.430+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64501b5a:::benchmark_data_smithi165_34272_object2043:head, will try copies on 3,4 2024-09-17T16:42:13.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.434+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:42:13.449 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.447+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:42:13.470 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.467+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5028689f:::benchmark_data_smithi165_34272_object3182:head, will try copies on 3,4 2024-09-17T16:42:13.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.484+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91259e85:::benchmark_data_smithi165_34272_object1969:head, will try copies on 0,4 2024-09-17T16:42:13.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.487+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb04d9d8:::benchmark_data_smithi165_34272_object4146:head, will try copies on 2,3 2024-09-17T16:42:13.495 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.493+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d53db62:::benchmark_data_smithi165_34272_object3614:head, will try copies on 0,4 2024-09-17T16:42:13.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.505+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66a97d86:::benchmark_data_smithi165_34272_object885:head, will try copies on 3,4 2024-09-17T16:42:13.518 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.516+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0af6fef:::benchmark_data_smithi165_34272_object2249:head, will try copies on 2,3 2024-09-17T16:42:13.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.522+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:42:13.536 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.534+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:42:13.555 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.553+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:42:13.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.572+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67d4f6c5:::benchmark_data_smithi165_34272_object243:head, will try copies on 3,4 2024-09-17T16:42:13.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.578+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b672de4f:::benchmark_data_smithi165_34272_object3011:head, will try copies on 2,3 2024-09-17T16:42:13.601 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.599+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:42:13.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.617+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8085d52:::benchmark_data_smithi165_34272_object471:head, will try copies on 2,3 2024-09-17T16:42:13.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.618+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:538512ad:::benchmark_data_smithi165_34272_object3115:head, will try copies on 3,4 2024-09-17T16:42:13.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.640+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e77549b:::benchmark_data_smithi165_34272_object1848:head, will try copies on 0,4 2024-09-17T16:42:13.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.644+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ecd0599:::benchmark_data_smithi165_34272_object4200:head, will try copies on 3,4 2024-09-17T16:42:13.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.645+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57414b9f:::benchmark_data_smithi165_34272_object2504:head, will try copies on 3,4 2024-09-17T16:42:13.661 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.659+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2827f15f:::benchmark_data_smithi165_34272_object4166:head, will try copies on 0,4 2024-09-17T16:42:13.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.660+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91781824:::benchmark_data_smithi165_34272_object61:head, will try copies on 0,4 2024-09-17T16:42:13.678 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.675+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:42:13.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.678+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:677f4769:::benchmark_data_smithi165_34272_object4499:head, will try copies on 3,4 2024-09-17T16:42:13.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.698+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:42:13.713 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.710+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13c7e1a:::benchmark_data_smithi165_34272_object863:head, will try copies on 2,3 2024-09-17T16:42:13.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.718+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b867ca7:::benchmark_data_smithi165_34272_object644:head, will try copies on 0,4 2024-09-17T16:42:13.725 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.722+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:42:13.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.729+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e92e973:::benchmark_data_smithi165_34272_object530:head, will try copies on 3,4 2024-09-17T16:42:13.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 350 15 4735976 4735961 845.631 865.438 0.000658578 0.00117181 2024-09-17T16:42:13.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.776+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502953f3:::benchmark_data_smithi165_34272_object2172:head, will try copies on 3,4 2024-09-17T16:42:13.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.779+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:42:13.785 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.783+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:42:13.807 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.805+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1285dd7:::benchmark_data_smithi165_34272_object818:head, will try copies on 2,3 2024-09-17T16:42:13.822 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.820+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:42:13.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.833+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4698664:::benchmark_data_smithi165_34272_object3065:head, will try copies on 2,3 2024-09-17T16:42:13.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.833+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:42:13.837 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.835+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:42:13.869 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.867+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:42:13.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.871+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92990a84:::benchmark_data_smithi165_34272_object4262:head, will try copies on 0,4 2024-09-17T16:42:13.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.898+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7c1d09:::benchmark_data_smithi165_34272_object2733:head, will try copies on 0,4 2024-09-17T16:42:13.912 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.910+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:42:13.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.911+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61905101:::benchmark_data_smithi165_34272_object393:head, will try copies on 3,4 2024-09-17T16:42:13.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.930+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:42:13.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.931+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68b93627:::benchmark_data_smithi165_34272_object3792:head, will try copies on 3,4 2024-09-17T16:42:13.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.938+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:42:13.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.963+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26ba6c0a:::benchmark_data_smithi165_34272_object2799:head, will try copies on 0,4 2024-09-17T16:42:13.966 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.964+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b709a3a9:::benchmark_data_smithi165_34272_object2544:head, will try copies on 2,3 2024-09-17T16:42:13.982 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.979+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:42:14.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:13.998+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:42:14.004 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.002+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:42:14.022 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.020+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084d763:::benchmark_data_smithi165_34272_object859:head, will try copies on 2,3 2024-09-17T16:42:14.029 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.027+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:42:14.049 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.047+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:42:14.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.050+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2d8db393:::benchmark_data_smithi165_34272_object1509:head, will try copies on 0,4 2024-09-17T16:42:14.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.054+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:42:14.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.071+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:42:14.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.088+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557e717c:::benchmark_data_smithi165_34272_object4513:head, will try copies on 3,4 2024-09-17T16:42:14.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.105+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26df2219:::benchmark_data_smithi165_34272_object1919:head, will try copies on 0,4 2024-09-17T16:42:14.121 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.118+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:42:14.123 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.121+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:42:14.129 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.127+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:42:14.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.157+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:949f2184:::benchmark_data_smithi165_34272_object4116:head, will try copies on 0,4 2024-09-17T16:42:14.162 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.160+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:282e5457:::benchmark_data_smithi165_34272_object2088:head, will try copies on 0,4 2024-09-17T16:42:14.180 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.178+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92269d4f:::benchmark_data_smithi165_34272_object3701:head, will try copies on 0,4 2024-09-17T16:42:14.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.181+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba140171:::benchmark_data_smithi165_34272_object1319:head, will try copies on 2,3 2024-09-17T16:42:14.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.192+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cdb5304:::benchmark_data_smithi165_34272_object3593:head, will try copies on 3,4 2024-09-17T16:42:14.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.198+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52f38bfe:::benchmark_data_smithi165_34272_object3880:head, will try copies on 3,4 2024-09-17T16:42:14.211 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.209+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9d0960e:::benchmark_data_smithi165_34272_object4012:head, will try copies on 2,3 2024-09-17T16:42:14.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.214+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:42:14.236 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.234+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:42:14.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.237+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:42:14.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.254+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:670d2b5e:::benchmark_data_smithi165_34272_object3924:head, will try copies on 3,4 2024-09-17T16:42:14.258 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.256+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240f4f1d:::benchmark_data_smithi165_34272_object2672:head, will try copies on 0,4 2024-09-17T16:42:14.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.282+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:42:14.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.283+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:42:14.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.286+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9022e0ca:::benchmark_data_smithi165_34272_object870:head, will try copies on 0,4 2024-09-17T16:42:14.310 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.307+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:42:14.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.313+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:42:14.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.313+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6303c80b:::benchmark_data_smithi165_34272_object2500:head, will try copies on 3,4 2024-09-17T16:42:14.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.314+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf9ef38c:::benchmark_data_smithi165_34272_object2367:head, will try copies on 2,3 2024-09-17T16:42:14.347 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.345+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93c9d4d7:::benchmark_data_smithi165_34272_object4056:head, will try copies on 0,4 2024-09-17T16:42:14.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.358+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65433bf3:::benchmark_data_smithi165_34272_object3394:head, will try copies on 3,4 2024-09-17T16:42:14.361 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.359+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:42:14.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.360+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:42:14.385 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.383+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:42:14.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.405+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb1ce58e:::benchmark_data_smithi165_34272_object3745:head, will try copies on 2,3 2024-09-17T16:42:14.408 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.405+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:42:14.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.418+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f71b974:::benchmark_data_smithi165_34272_object1976:head, will try copies on 3,4 2024-09-17T16:42:14.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.429+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:42:14.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.433+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:42:14.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.434+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9beed1cd:::benchmark_data_smithi165_34272_object529:head, will try copies on 0,4 2024-09-17T16:42:14.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.458+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:42:14.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.458+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b112cb6:::benchmark_data_smithi165_34272_object3704:head, will try copies on 3,4 2024-09-17T16:42:14.481 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.479+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:42:14.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.480+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:42:14.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.504+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64cad03f:::benchmark_data_smithi165_34272_object4031:head, will try copies on 3,4 2024-09-17T16:42:14.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.521+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57b1d134:::benchmark_data_smithi165_34272_object2904:head, will try copies on 3,4 2024-09-17T16:42:14.525 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.523+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fad271:::benchmark_data_smithi165_34272_object4384:head, will try copies on 2,3 2024-09-17T16:42:14.531 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.529+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:42:14.547 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.544+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd4eeec:::benchmark_data_smithi165_34272_object2673:head, will try copies on 3,4 2024-09-17T16:42:14.567 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.564+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:42:14.570 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.567+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6790c353:::benchmark_data_smithi165_34272_object1162:head, will try copies on 3,4 2024-09-17T16:42:14.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.572+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:42:14.598 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.596+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:223130cb:::benchmark_data_smithi165_34272_object1865:head, will try copies on 0,4 2024-09-17T16:42:14.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.607+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:42:14.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.617+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6366b3d3:::benchmark_data_smithi165_34272_object2226:head, will try copies on 3,4 2024-09-17T16:42:14.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.630+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ae6115e:::benchmark_data_smithi165_34272_object4528:head, will try copies on 3,4 2024-09-17T16:42:14.638 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.636+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:42:14.641 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.639+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20ffb69e:::benchmark_data_smithi165_34272_object41:head, will try copies on 0,4 2024-09-17T16:42:14.647 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.645+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9941c9bb:::benchmark_data_smithi165_34272_object2779:head, will try copies on 0,4 2024-09-17T16:42:14.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:528a6890:::benchmark_data_smithi165_34272_object3096:head, will try copies on 3,4 2024-09-17T16:42:14.668 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.665+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:42:14.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.671+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:42:14.691 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.689+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9949540d:::benchmark_data_smithi165_34272_object3869:head, will try copies on 0,4 2024-09-17T16:42:14.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.722+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64090b86:::benchmark_data_smithi165_34272_object680:head, will try copies on 3,4 2024-09-17T16:42:14.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.723+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:42:14.727 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.725+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2a5e4d2:::benchmark_data_smithi165_34272_object410:head, will try copies on 2,3 2024-09-17T16:42:14.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.744+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97cac8c0:::benchmark_data_smithi165_34272_object1703:head, will try copies on 0,4 2024-09-17T16:42:14.747 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.745+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:42:14.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 351 16 4749729 4749713 845.67 859.5 0.000566862 0.00117174 2024-09-17T16:42:14.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.777+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:42:14.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.779+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:42:14.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.783+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4576cd:::benchmark_data_smithi165_34272_object238:head, will try copies on 3,4 2024-09-17T16:42:14.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.786+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91bdc49f:::benchmark_data_smithi165_34272_object1294:head, will try copies on 0,4 2024-09-17T16:42:14.830 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.828+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b789200:::benchmark_data_smithi165_34272_object1368:head, will try copies on 3,4 2024-09-17T16:42:14.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.836+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb6074a6:::benchmark_data_smithi165_34272_object4514:head, will try copies on 2,3 2024-09-17T16:42:14.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.837+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:916b863e:::benchmark_data_smithi165_34272_object4381:head, will try copies on 0,4 2024-09-17T16:42:14.852 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.850+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5da14e81:::benchmark_data_smithi165_34272_object774:head, will try copies on 3,4 2024-09-17T16:42:14.864 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.862+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:42:14.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.871+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb605378:::benchmark_data_smithi165_34272_object724:head, will try copies on 2,3 2024-09-17T16:42:14.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.871+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96d5d4f7:::benchmark_data_smithi165_34272_object583:head, will try copies on 0,4 2024-09-17T16:42:14.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.872+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b5eff94:::benchmark_data_smithi165_34272_object298:head, will try copies on 3,4 2024-09-17T16:42:14.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.880+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:42:14.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.904+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:42:14.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.916+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:42:14.932 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.930+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65fc224b:::benchmark_data_smithi165_34272_object1968:head, will try copies on 3,4 2024-09-17T16:42:14.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.939+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:42:14.942 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.939+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92b405d5:::benchmark_data_smithi165_34272_object892:head, will try copies on 0,4 2024-09-17T16:42:14.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.952+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:42:14.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.973+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:42:14.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.979+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e1aabb0:::benchmark_data_smithi165_34272_object3308:head, will try copies on 0,4 2024-09-17T16:42:14.988 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:14.986+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25e3d051:::benchmark_data_smithi165_34272_object1683:head, will try copies on 0,4 2024-09-17T16:42:15.002 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.000+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb0772b2:::benchmark_data_smithi165_34272_object3424:head, will try copies on 2,3 2024-09-17T16:42:15.007 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.004+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:42:15.021 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.018+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8fd0dba:::benchmark_data_smithi165_34272_object1122:head, will try copies on 2,3 2024-09-17T16:42:15.023 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.021+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52ce3bfa:::benchmark_data_smithi165_34272_object1774:head, will try copies on 3,4 2024-09-17T16:42:15.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.034+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6733c8b5:::benchmark_data_smithi165_34272_object2809:head, will try copies on 3,4 2024-09-17T16:42:15.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.039+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94330fa7:::benchmark_data_smithi165_34272_object2761:head, will try copies on 0,4 2024-09-17T16:42:15.044 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.042+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d4cb62:::benchmark_data_smithi165_34272_object1253:head, will try copies on 0,4 2024-09-17T16:42:15.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.052+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c8baabd:::benchmark_data_smithi165_34272_object1663:head, will try copies on 3,4 2024-09-17T16:42:15.093 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.090+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cadcb9c:::benchmark_data_smithi165_34272_object1129:head, will try copies on 3,4 2024-09-17T16:42:15.126 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.124+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61cdcad7:::benchmark_data_smithi165_34272_object1776:head, will try copies on 3,4 2024-09-17T16:42:15.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.151+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:42:15.169 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.167+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fbb55bb:::benchmark_data_smithi165_34272_object2754:head, will try copies on 3,4 2024-09-17T16:42:15.176 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.174+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:42:15.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.185+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5783559d:::benchmark_data_smithi165_34272_object2848:head, will try copies on 3,4 2024-09-17T16:42:15.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.200+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bdcdca56:::benchmark_data_smithi165_34272_object158:head, will try copies on 2,3 2024-09-17T16:42:15.206 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.203+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:42:15.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.238+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:42:15.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.238+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c2386fa:::benchmark_data_smithi165_34272_object1256:head, will try copies on 0,4 2024-09-17T16:42:15.247 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.245+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:42:15.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.248+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:42:15.265 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.263+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:42:15.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.277+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:42:15.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.280+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6548deba:::benchmark_data_smithi165_34272_object3574:head, will try copies on 3,4 2024-09-17T16:42:15.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.285+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:42:15.292 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.290+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97da13d9:::benchmark_data_smithi165_34272_object1849:head, will try copies on 0,4 2024-09-17T16:42:15.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.317+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a3176db:::benchmark_data_smithi165_34272_object3820:head, will try copies on 3,4 2024-09-17T16:42:15.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.331+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bfd1c799:::benchmark_data_smithi165_34272_object1369:head, will try copies on 2,3 2024-09-17T16:42:15.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.332+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:42:15.340 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.338+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50b2d41a:::benchmark_data_smithi165_34272_object2638:head, will try copies on 3,4 2024-09-17T16:42:15.342 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.340+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:42:15.359 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.357+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ac8cb28:::benchmark_data_smithi165_34272_object1798:head, will try copies on 0,4 2024-09-17T16:42:15.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.357+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:42:15.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.378+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd3fcfd5:::benchmark_data_smithi165_34272_object2422:head, will try copies on 2,3 2024-09-17T16:42:15.398 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.395+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:42:15.407 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.405+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bc22170:::benchmark_data_smithi165_34272_object3731:head, will try copies on 3,4 2024-09-17T16:42:15.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.421+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:42:15.436 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.434+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f29f424:::benchmark_data_smithi165_34272_object2159:head, will try copies on 0,4 2024-09-17T16:42:15.468 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.466+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:42:15.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.469+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ef71d8a:::benchmark_data_smithi165_34272_object4348:head, will try copies on 3,4 2024-09-17T16:42:15.479 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.476+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26cf49bd:::benchmark_data_smithi165_34272_object1127:head, will try copies on 0,4 2024-09-17T16:42:15.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.483+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:42:15.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.487+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9ca79cf:::benchmark_data_smithi165_34272_object984:head, will try copies on 2,3 2024-09-17T16:42:15.506 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.504+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:42:15.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.514+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:42:15.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.555+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:275bdaa4:::benchmark_data_smithi165_34272_object604:head, will try copies on 0,4 2024-09-17T16:42:15.572 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.570+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5bb34fc6:::benchmark_data_smithi165_34272_object1408:head, will try copies on 3,4 2024-09-17T16:42:15.587 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.584+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1315d6:::benchmark_data_smithi165_34272_object28:head, will try copies on 0,4 2024-09-17T16:42:15.606 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.604+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6369c03:::benchmark_data_smithi165_34272_object3058:head, will try copies on 2,3 2024-09-17T16:42:15.609 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.607+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:42:15.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.609+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:42:15.635 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.633+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:42:15.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.638+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9537023b:::benchmark_data_smithi165_34272_object450:head, will try copies on 0,4 2024-09-17T16:42:15.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.644+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:42:15.665 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.663+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1fe284a:::benchmark_data_smithi165_34272_object3474:head, will try copies on 2,3 2024-09-17T16:42:15.693 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.690+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:42:15.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.714+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:42:15.724 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.722+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50008a3d:::benchmark_data_smithi165_34272_object1029:head, will try copies on 3,4 2024-09-17T16:42:15.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.732+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:42:15.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.758+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b36c331:::benchmark_data_smithi165_34272_object3174:head, will try copies on 3,4 2024-09-17T16:42:15.762 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.760+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90c04ea0:::benchmark_data_smithi165_34272_object911:head, will try copies on 0,4 2024-09-17T16:42:15.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.761+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:42:15.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 352 15 4763504 4763489 845.713 861 0.00105686 0.00117169 2024-09-17T16:42:15.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.772+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2503407b:::benchmark_data_smithi165_34272_object2984:head, will try copies on 0,4 2024-09-17T16:42:15.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.779+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:42:15.787 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.785+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:42:15.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.813+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9427456d:::benchmark_data_smithi165_34272_object2189:head, will try copies on 0,4 2024-09-17T16:42:15.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.834+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93712cf8:::benchmark_data_smithi165_34272_object3180:head, will try copies on 0,4 2024-09-17T16:42:15.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.836+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb974859:::benchmark_data_smithi165_34272_object289:head, will try copies on 2,3 2024-09-17T16:42:15.849 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.847+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:42:15.860 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.858+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a758db6:::benchmark_data_smithi165_34272_object2839:head, will try copies on 0,4 2024-09-17T16:42:15.876 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.872+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:42:15.881 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.879+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e7eedee:::benchmark_data_smithi165_34272_object619:head, will try copies on 3,4 2024-09-17T16:42:15.888 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.886+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:215169fc:::benchmark_data_smithi165_34272_object3301:head, will try copies on 0,4 2024-09-17T16:42:15.890 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.888+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92f0be59:::benchmark_data_smithi165_34272_object3343:head, will try copies on 0,4 2024-09-17T16:42:15.913 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.911+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:42:15.933 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.931+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2177321f:::benchmark_data_smithi165_34272_object579:head, will try copies on 0,4 2024-09-17T16:42:15.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.938+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:42:15.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.954+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e82a70:::benchmark_data_smithi165_34272_object3020:head, will try copies on 3,4 2024-09-17T16:42:15.960 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.958+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:42:15.971 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.969+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:42:15.975 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:15.973+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:42:16.003 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.001+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20a883fe:::benchmark_data_smithi165_34272_object2828:head, will try copies on 0,4 2024-09-17T16:42:16.008 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.006+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:42:16.019 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.017+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d63c36f:::benchmark_data_smithi165_34272_object3545:head, will try copies on 3,4 2024-09-17T16:42:16.037 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.035+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2628dc30:::benchmark_data_smithi165_34272_object603:head, will try copies on 0,4 2024-09-17T16:42:16.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.043+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68fbad61:::benchmark_data_smithi165_34272_object2031:head, will try copies on 3,4 2024-09-17T16:42:16.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.051+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2746239a:::benchmark_data_smithi165_34272_object1363:head, will try copies on 0,4 2024-09-17T16:42:16.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.054+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b19d1c75:::benchmark_data_smithi165_34272_object144:head, will try copies on 2,3 2024-09-17T16:42:16.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.063+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c4f0411:::benchmark_data_smithi165_34272_object1450:head, will try copies on 3,4 2024-09-17T16:42:16.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.070+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9327a87c:::benchmark_data_smithi165_34272_object275:head, will try copies on 0,4 2024-09-17T16:42:16.092 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.090+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26d0a02b:::benchmark_data_smithi165_34272_object496:head, will try copies on 0,4 2024-09-17T16:42:16.125 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.122+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:56a5dcdb:::benchmark_data_smithi165_34272_object776:head, will try copies on 3,4 2024-09-17T16:42:16.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.136+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:692e3a03:::benchmark_data_smithi165_34272_object2050:head, will try copies on 3,4 2024-09-17T16:42:16.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.139+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b80758d8:::benchmark_data_smithi165_34272_object4142:head, will try copies on 2,3 2024-09-17T16:42:16.143 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.141+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f1fb68c:::benchmark_data_smithi165_34272_object4429:head, will try copies on 0,4 2024-09-17T16:42:16.147 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.145+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94809fcd:::benchmark_data_smithi165_34272_object4184:head, will try copies on 0,4 2024-09-17T16:42:16.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.163+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57022e18:::benchmark_data_smithi165_34272_object3341:head, will try copies on 3,4 2024-09-17T16:42:16.171 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.169+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6f8feff:::benchmark_data_smithi165_34272_object1166:head, will try copies on 2,3 2024-09-17T16:42:16.178 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.175+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:42:16.192 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.190+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:42:16.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5148ef77:::benchmark_data_smithi165_34272_object1612:head, will try copies on 3,4 2024-09-17T16:42:16.223 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.221+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:42:16.230 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.228+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6212f37e:::benchmark_data_smithi165_34272_object2454:head, will try copies on 3,4 2024-09-17T16:42:16.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.248+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:42:16.251 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.249+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:42:16.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.268+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:42:16.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.285+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:42:16.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.288+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b509516c:::benchmark_data_smithi165_34272_object762:head, will try copies on 2,3 2024-09-17T16:42:16.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.298+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a3f2cd5:::benchmark_data_smithi165_34272_object3257:head, will try copies on 0,4 2024-09-17T16:42:16.325 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.322+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c920cb4:::benchmark_data_smithi165_34272_object3546:head, will try copies on 0,4 2024-09-17T16:42:16.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.333+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd49f1a5:::benchmark_data_smithi165_34272_object1344:head, will try copies on 2,3 2024-09-17T16:42:16.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.341+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644844ea:::benchmark_data_smithi165_34272_object2853:head, will try copies on 3,4 2024-09-17T16:42:16.346 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.343+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:42:16.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.372+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fbedc4e:::benchmark_data_smithi165_34272_object2140:head, will try copies on 0,4 2024-09-17T16:42:16.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.373+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5af0b114:::benchmark_data_smithi165_34272_object2727:head, will try copies on 3,4 2024-09-17T16:42:16.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.393+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:42:16.403 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.401+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b464018a:::benchmark_data_smithi165_34272_object3479:head, will try copies on 2,3 2024-09-17T16:42:16.426 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.424+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a9432c:::benchmark_data_smithi165_34272_object3993:head, will try copies on 3,4 2024-09-17T16:42:16.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.441+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:42:16.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.442+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ba76b73:::benchmark_data_smithi165_34272_object2775:head, will try copies on 3,4 2024-09-17T16:42:16.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.443+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ce3cad:::benchmark_data_smithi165_34272_object2687:head, will try copies on 3,4 2024-09-17T16:42:16.457 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.455+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:298fef81:::benchmark_data_smithi165_34272_object1300:head, will try copies on 0,4 2024-09-17T16:42:16.489 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.487+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2db2d4fe:::benchmark_data_smithi165_34272_object3510:head, will try copies on 0,4 2024-09-17T16:42:16.504 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.502+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:42:16.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.506+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:42:16.529 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.527+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926d6867:::benchmark_data_smithi165_34272_object3117:head, will try copies on 0,4 2024-09-17T16:42:16.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.536+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:42:16.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.560+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:42:16.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.572+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:42:16.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.577+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:42:16.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.578+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b3f75b:::benchmark_data_smithi165_34272_object4562:head, will try copies on 3,4 2024-09-17T16:42:16.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.588+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:42:16.620 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.618+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:42:16.639 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.637+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ff2df66:::benchmark_data_smithi165_34272_object2950:head, will try copies on 0,4 2024-09-17T16:42:16.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.653+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649d122c:::benchmark_data_smithi165_34272_object867:head, will try copies on 3,4 2024-09-17T16:42:16.664 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.662+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5314e919:::benchmark_data_smithi165_34272_object3851:head, will try copies on 3,4 2024-09-17T16:42:16.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.672+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:630fcd42:::benchmark_data_smithi165_34272_object4437:head, will try copies on 3,4 2024-09-17T16:42:16.680 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.678+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:231db51c:::benchmark_data_smithi165_34272_object3705:head, will try copies on 0,4 2024-09-17T16:42:16.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.679+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be0a96ec:::benchmark_data_smithi165_34272_object4287:head, will try copies on 2,3 2024-09-17T16:42:16.686 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.683+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5fc4e42b:::benchmark_data_smithi165_34272_object4169:head, will try copies on 3,4 2024-09-17T16:42:16.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.695+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:42:16.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.716+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:42:16.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.729+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:940f27b9:::benchmark_data_smithi165_34272_object981:head, will try copies on 0,4 2024-09-17T16:42:16.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.730+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f4fb840:::benchmark_data_smithi165_34272_object3532:head, will try copies on 3,4 2024-09-17T16:42:16.748 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.746+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6380a727:::benchmark_data_smithi165_34272_object4100:head, will try copies on 3,4 2024-09-17T16:42:16.763 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.761+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29856b5f:::benchmark_data_smithi165_34272_object265:head, will try copies on 0,4 2024-09-17T16:42:16.768 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 353 16 4777309 4777293 845.761 862.75 0.00365763 0.00117162 2024-09-17T16:42:16.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.769+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:971041ec:::benchmark_data_smithi165_34272_object4256:head, will try copies on 0,4 2024-09-17T16:42:16.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.788+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:42:16.793 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.791+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:42:16.795 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.793+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6edf0bf8:::benchmark_data_smithi165_34272_object715:head, will try copies on 3,4 2024-09-17T16:42:16.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.798+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:997600ff:::benchmark_data_smithi165_34272_object4022:head, will try copies on 0,4 2024-09-17T16:42:16.816 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.814+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e8f4c5c:::benchmark_data_smithi165_34272_object4250:head, will try copies on 0,4 2024-09-17T16:42:16.823 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.821+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3afbf0:::benchmark_data_smithi165_34272_object1392:head, will try copies on 3,4 2024-09-17T16:42:16.833 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.831+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd12d0fe:::benchmark_data_smithi165_34272_object1681:head, will try copies on 2,3 2024-09-17T16:42:16.836 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.834+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6fd22153:::benchmark_data_smithi165_34272_object4038:head, will try copies on 3,4 2024-09-17T16:42:16.844 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.842+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:42:16.855 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.852+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de653b3:::benchmark_data_smithi165_34272_object1638:head, will try copies on 3,4 2024-09-17T16:42:16.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.855+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23b753a6:::benchmark_data_smithi165_34272_object2518:head, will try copies on 0,4 2024-09-17T16:42:16.884 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.882+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb109d90:::benchmark_data_smithi165_34272_object4260:head, will try copies on 2,3 2024-09-17T16:42:16.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.891+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cdc1b33:::benchmark_data_smithi165_34272_object3960:head, will try copies on 3,4 2024-09-17T16:42:16.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.912+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b890f6a9:::benchmark_data_smithi165_34272_object2178:head, will try copies on 2,3 2024-09-17T16:42:16.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.932+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:42:16.954 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.952+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24b272f4:::benchmark_data_smithi165_34272_object47:head, will try copies on 0,4 2024-09-17T16:42:16.955 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.953+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:679f9727:::benchmark_data_smithi165_34272_object1189:head, will try copies on 3,4 2024-09-17T16:42:16.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.955+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f00609e:::benchmark_data_smithi165_34272_object1814:head, will try copies on 3,4 2024-09-17T16:42:16.963 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.961+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:42:16.981 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.979+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6ce1910:::benchmark_data_smithi165_34272_object103:head, will try copies on 2,3 2024-09-17T16:42:16.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.981+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64de8181:::benchmark_data_smithi165_34272_object1013:head, will try copies on 3,4 2024-09-17T16:42:16.999 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:16.997+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f246a4d:::benchmark_data_smithi165_34272_object609:head, will try copies on 0,4 2024-09-17T16:42:17.006 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.004+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:595828b2:::benchmark_data_smithi165_34272_object2103:head, will try copies on 3,4 2024-09-17T16:42:17.043 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.040+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661fc3b2:::benchmark_data_smithi165_34272_object1278:head, will try copies on 3,4 2024-09-17T16:42:17.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.045+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c0bbb04:::benchmark_data_smithi165_34272_object1458:head, will try copies on 3,4 2024-09-17T16:42:17.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.050+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc58d4b0:::benchmark_data_smithi165_34272_object932:head, will try copies on 2,3 2024-09-17T16:42:17.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.055+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f9a89d1:::benchmark_data_smithi165_34272_object1126:head, will try copies on 0,4 2024-09-17T16:42:17.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.071+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6ccec225:::benchmark_data_smithi165_34272_object1008:head, will try copies on 3,4 2024-09-17T16:42:17.076 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.074+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5adb1319:::benchmark_data_smithi165_34272_object4097:head, will try copies on 3,4 2024-09-17T16:42:17.090 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.087+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4e8ca71:::benchmark_data_smithi165_34272_object1382:head, will try copies on 2,3 2024-09-17T16:42:17.099 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.096+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b939955:::benchmark_data_smithi165_34272_object888:head, will try copies on 3,4 2024-09-17T16:42:17.100 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.098+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:946ae13f:::benchmark_data_smithi165_34272_object376:head, will try copies on 0,4 2024-09-17T16:42:17.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.126+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:42:17.136 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.134+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:42:17.140 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.138+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2919dea0:::benchmark_data_smithi165_34272_object184:head, will try copies on 0,4 2024-09-17T16:42:17.142 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.139+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51acfb61:::benchmark_data_smithi165_34272_object2202:head, will try copies on 3,4 2024-09-17T16:42:17.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.172+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2115de09:::benchmark_data_smithi165_34272_object584:head, will try copies on 0,4 2024-09-17T16:42:17.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.192+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0b22e0f:::benchmark_data_smithi165_34272_object3717:head, will try copies on 2,3 2024-09-17T16:42:17.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.192+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dec8ad6:::benchmark_data_smithi165_34272_object1225:head, will try copies on 3,4 2024-09-17T16:42:17.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.204+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0226a39:::benchmark_data_smithi165_34272_object1887:head, will try copies on 2,3 2024-09-17T16:42:17.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.210+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:42:17.228 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.226+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9842f3a3:::benchmark_data_smithi165_34272_object1542:head, will try copies on 0,4 2024-09-17T16:42:17.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.257+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c02a484:::benchmark_data_smithi165_34272_object1387:head, will try copies on 3,4 2024-09-17T16:42:17.264 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.262+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b60f19ee:::benchmark_data_smithi165_34272_object305:head, will try copies on 2,3 2024-09-17T16:42:17.279 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.277+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9be9025b:::benchmark_data_smithi165_34272_object2268:head, will try copies on 0,4 2024-09-17T16:42:17.288 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.286+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68f1c42a:::benchmark_data_smithi165_34272_object788:head, will try copies on 3,4 2024-09-17T16:42:17.296 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.294+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:42:17.302 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.300+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917f1d56:::benchmark_data_smithi165_34272_object683:head, will try copies on 0,4 2024-09-17T16:42:17.306 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.303+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72447a:::benchmark_data_smithi165_34272_object2581:head, will try copies on 2,3 2024-09-17T16:42:17.308 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.305+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8587f:::benchmark_data_smithi165_34272_object3283:head, will try copies on 0,4 2024-09-17T16:42:17.334 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.331+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649fc9bc:::benchmark_data_smithi165_34272_object1009:head, will try copies on 3,4 2024-09-17T16:42:17.335 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.333+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97606d08:::benchmark_data_smithi165_34272_object1593:head, will try copies on 0,4 2024-09-17T16:42:17.341 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.339+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57581fb2:::benchmark_data_smithi165_34272_object3480:head, will try copies on 3,4 2024-09-17T16:42:17.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.363+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:42:17.380 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.378+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b746a836:::benchmark_data_smithi165_34272_object1778:head, will try copies on 2,3 2024-09-17T16:42:17.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.392+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:42:17.437 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.434+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:42:17.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.438+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:42:17.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.444+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:42:17.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.469+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:629d0911:::benchmark_data_smithi165_34272_object1961:head, will try copies on 3,4 2024-09-17T16:42:17.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.472+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26c8ad95:::benchmark_data_smithi165_34272_object1334:head, will try copies on 0,4 2024-09-17T16:42:17.486 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.484+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50516da2:::benchmark_data_smithi165_34272_object3043:head, will try copies on 3,4 2024-09-17T16:42:17.517 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.515+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53fb6036:::benchmark_data_smithi165_34272_object1491:head, will try copies on 3,4 2024-09-17T16:42:17.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.537+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:42:17.539 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.537+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:42:17.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.559+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba1286:::benchmark_data_smithi165_34272_object2626:head, will try copies on 3,4 2024-09-17T16:42:17.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.575+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29b6a7d8:::benchmark_data_smithi165_34272_object3525:head, will try copies on 0,4 2024-09-17T16:42:17.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.580+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59a19d51:::benchmark_data_smithi165_34272_object4399:head, will try copies on 3,4 2024-09-17T16:42:17.591 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.589+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6de9d375:::benchmark_data_smithi165_34272_object1301:head, will try copies on 3,4 2024-09-17T16:42:17.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.610+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b744fcb:::benchmark_data_smithi165_34272_object3592:head, will try copies on 0,4 2024-09-17T16:42:17.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.610+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b12207fc:::benchmark_data_smithi165_34272_object1292:head, will try copies on 2,3 2024-09-17T16:42:17.613 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.610+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:42:17.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.625+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:42:17.636 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.634+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24768583:::benchmark_data_smithi165_34272_object3305:head, will try copies on 0,4 2024-09-17T16:42:17.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.640+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:42:17.675 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.673+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5910537c:::benchmark_data_smithi165_34272_object1579:head, will try copies on 3,4 2024-09-17T16:42:17.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.683+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be57109f:::benchmark_data_smithi165_34272_object3611:head, will try copies on 2,3 2024-09-17T16:42:17.695 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.693+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bb3c8af:::benchmark_data_smithi165_34272_object1526:head, will try copies on 0,4 2024-09-17T16:42:17.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.710+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f059f4c:::benchmark_data_smithi165_34272_object4516:head, will try copies on 3,4 2024-09-17T16:42:17.736 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.734+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b6cfe6b:::benchmark_data_smithi165_34272_object2:head, will try copies on 3,4 2024-09-17T16:42:17.746 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.744+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623d3858:::benchmark_data_smithi165_34272_object1350:head, will try copies on 3,4 2024-09-17T16:42:17.753 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.750+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fb465ad:::benchmark_data_smithi165_34272_object163:head, will try copies on 0,4 2024-09-17T16:42:17.760 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.758+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:661c4a50:::benchmark_data_smithi165_34272_object2044:head, will try copies on 3,4 2024-09-17T16:42:17.765 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.763+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966b5966:::benchmark_data_smithi165_34272_object802:head, will try copies on 0,4 2024-09-17T16:42:17.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 354 16 4790912 4790896 845.774 850.188 0.000520622 0.00117161 2024-09-17T16:42:17.772 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.770+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:42:17.777 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.775+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5dba0f57:::benchmark_data_smithi165_34272_object1305:head, will try copies on 3,4 2024-09-17T16:42:17.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.789+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ecdefee:::benchmark_data_smithi165_34272_object3238:head, will try copies on 0,4 2024-09-17T16:42:17.792 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.790+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:42:17.839 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.837+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f440a6:::benchmark_data_smithi165_34272_object1825:head, will try copies on 0,4 2024-09-17T16:42:17.845 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.843+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6383643b:::benchmark_data_smithi165_34272_object3821:head, will try copies on 3,4 2024-09-17T16:42:17.856 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.854+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:42:17.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.863+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90482494:::benchmark_data_smithi165_34272_object3076:head, will try copies on 0,4 2024-09-17T16:42:17.878 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.876+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20f048d9:::benchmark_data_smithi165_34272_object1239:head, will try copies on 0,4 2024-09-17T16:42:17.880 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.878+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:695e95bf:::benchmark_data_smithi165_34272_object2872:head, will try copies on 3,4 2024-09-17T16:42:17.887 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.885+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b877f9e1:::benchmark_data_smithi165_34272_object1212:head, will try copies on 2,3 2024-09-17T16:42:17.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.895+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d64131f:::benchmark_data_smithi165_34272_object3461:head, will try copies on 0,4 2024-09-17T16:42:17.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.904+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25a123a3:::benchmark_data_smithi165_34272_object3587:head, will try copies on 0,4 2024-09-17T16:42:17.920 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.917+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:42:17.930 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.928+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b53383e4:::benchmark_data_smithi165_34272_object2203:head, will try copies on 2,3 2024-09-17T16:42:17.946 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.943+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29009868:::benchmark_data_smithi165_34272_object1822:head, will try copies on 0,4 2024-09-17T16:42:17.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.948+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570521a3:::benchmark_data_smithi165_34272_object4387:head, will try copies on 3,4 2024-09-17T16:42:17.968 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.966+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c685dee:::benchmark_data_smithi165_34272_object2244:head, will try copies on 3,4 2024-09-17T16:42:17.973 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.971+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:42:17.990 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.987+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cfa01cf:::benchmark_data_smithi165_34272_object916:head, will try copies on 0,4 2024-09-17T16:42:17.996 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:17.994+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:42:18.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.009+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c7561b8:::benchmark_data_smithi165_34272_object4362:head, will try copies on 3,4 2024-09-17T16:42:18.020 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.017+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8760dec:::benchmark_data_smithi165_34272_object1597:head, will try copies on 2,3 2024-09-17T16:42:18.027 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.024+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:42:18.034 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.031+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:42:18.054 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.051+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a469d1f:::benchmark_data_smithi165_34272_object857:head, will try copies on 0,4 2024-09-17T16:42:18.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.066+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98650a8e:::benchmark_data_smithi165_34272_object4392:head, will try copies on 0,4 2024-09-17T16:42:18.081 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.078+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb8b21e:::benchmark_data_smithi165_34272_object3709:head, will try copies on 0,4 2024-09-17T16:42:18.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.084+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ba7acc8:::benchmark_data_smithi165_34272_object2516:head, will try copies on 0,4 2024-09-17T16:42:18.107 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.105+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a99e7cf:::benchmark_data_smithi165_34272_object1213:head, will try copies on 0,4 2024-09-17T16:42:18.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.105+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64aaef6e:::benchmark_data_smithi165_34272_object2356:head, will try copies on 3,4 2024-09-17T16:42:18.108 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.106+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:554d8ba3:::benchmark_data_smithi165_34272_object2217:head, will try copies on 3,4 2024-09-17T16:42:18.112 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.110+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ecfa7c:::benchmark_data_smithi165_34272_object3672:head, will try copies on 0,4 2024-09-17T16:42:18.154 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.152+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf48d40f:::benchmark_data_smithi165_34272_object4462:head, will try copies on 2,3 2024-09-17T16:42:18.156 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.154+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2c85769c:::benchmark_data_smithi165_34272_object2630:head, will try copies on 0,4 2024-09-17T16:42:18.157 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.155+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c50298b:::benchmark_data_smithi165_34272_object803:head, will try copies on 3,4 2024-09-17T16:42:18.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.172+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:42:18.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.173+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bc95f907:::benchmark_data_smithi165_34272_object467:head, will try copies on 2,3 2024-09-17T16:42:18.182 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.180+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a4a34d6:::benchmark_data_smithi165_34272_object1965:head, will try copies on 0,4 2024-09-17T16:42:18.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.198+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64d068af:::benchmark_data_smithi165_34272_object2690:head, will try copies on 3,4 2024-09-17T16:42:18.220 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.218+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51101ed3:::benchmark_data_smithi165_34272_object3351:head, will try copies on 3,4 2024-09-17T16:42:18.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.224+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23d4be26:::benchmark_data_smithi165_34272_object1784:head, will try copies on 0,4 2024-09-17T16:42:18.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.232+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:42:18.237 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.234+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:42:18.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.242+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0cd178d:::benchmark_data_smithi165_34272_object4300:head, will try copies on 2,3 2024-09-17T16:42:18.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.246+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f917099:::benchmark_data_smithi165_34272_object497:head, will try copies on 3,4 2024-09-17T16:42:18.268 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.265+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29278e94:::benchmark_data_smithi165_34272_object4294:head, will try copies on 0,4 2024-09-17T16:42:18.287 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.285+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96ae53fb:::benchmark_data_smithi165_34272_object3250:head, will try copies on 0,4 2024-09-17T16:42:18.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.299+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf919101:::benchmark_data_smithi165_34272_object3908:head, will try copies on 2,3 2024-09-17T16:42:18.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.301+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55e8eeec:::benchmark_data_smithi165_34272_object3676:head, will try copies on 3,4 2024-09-17T16:42:18.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.314+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98755ee6:::benchmark_data_smithi165_34272_object547:head, will try copies on 0,4 2024-09-17T16:42:18.319 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.317+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e280e9f:::benchmark_data_smithi165_34272_object4498:head, will try copies on 3,4 2024-09-17T16:42:18.328 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.326+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:42:18.363 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.360+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67094329:::benchmark_data_smithi165_34272_object2652:head, will try copies on 3,4 2024-09-17T16:42:18.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.362+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5789d8d5:::benchmark_data_smithi165_34272_object1622:head, will try copies on 3,4 2024-09-17T16:42:18.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.373+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:42:18.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.385+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:42:18.402 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.400+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:64eefcca:::benchmark_data_smithi165_34272_object2002:head, will try copies on 3,4 2024-09-17T16:42:18.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.418+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8408cd8:::benchmark_data_smithi165_34272_object2168:head, will try copies on 2,3 2024-09-17T16:42:18.428 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.426+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:42:18.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.445+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:206287b8:::benchmark_data_smithi165_34272_object2098:head, will try copies on 0,4 2024-09-17T16:42:18.460 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.458+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:42:18.490 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.488+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f64d45b:::benchmark_data_smithi165_34272_object1765:head, will try copies on 0,4 2024-09-17T16:42:18.501 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.498+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2f3cc88c:::benchmark_data_smithi165_34272_object487:head, will try copies on 0,4 2024-09-17T16:42:18.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.500+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:620c4add:::benchmark_data_smithi165_34272_object4476:head, will try copies on 3,4 2024-09-17T16:42:18.512 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.510+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:917d9707:::benchmark_data_smithi165_34272_object1425:head, will try copies on 0,4 2024-09-17T16:42:18.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.532+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:42:18.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.542+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91eae21c:::benchmark_data_smithi165_34272_object882:head, will try copies on 0,4 2024-09-17T16:42:18.554 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.552+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:42:18.563 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.559+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:42:18.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.562+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28bd89cc:::benchmark_data_smithi165_34272_object3831:head, will try copies on 0,4 2024-09-17T16:42:18.575 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.573+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9afef930:::benchmark_data_smithi165_34272_object4263:head, will try copies on 0,4 2024-09-17T16:42:18.577 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.575+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4554061:::benchmark_data_smithi165_34272_object781:head, will try copies on 2,3 2024-09-17T16:42:18.585 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.583+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:557ec3f7:::benchmark_data_smithi165_34272_object3992:head, will try copies on 3,4 2024-09-17T16:42:18.630 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.628+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf7c3350:::benchmark_data_smithi165_34272_object2920:head, will try copies on 2,3 2024-09-17T16:42:18.633 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.630+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90f06ca8:::benchmark_data_smithi165_34272_object689:head, will try copies on 0,4 2024-09-17T16:42:18.655 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.652+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ec21dc4:::benchmark_data_smithi165_34272_object2300:head, will try copies on 3,4 2024-09-17T16:42:18.666 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.664+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c162764:::benchmark_data_smithi165_34272_object824:head, will try copies on 0,4 2024-09-17T16:42:18.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.670+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:42:18.685 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.683+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:42:18.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.685+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cc03ede:::benchmark_data_smithi165_34272_object225:head, will try copies on 0,4 2024-09-17T16:42:18.702 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.700+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:683eb3ff:::benchmark_data_smithi165_34272_object4140:head, will try copies on 3,4 2024-09-17T16:42:18.710 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.708+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:42:18.715 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.712+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22230337:::benchmark_data_smithi165_34272_object3119:head, will try copies on 0,4 2024-09-17T16:42:18.734 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.732+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b54080e:::benchmark_data_smithi165_34272_object3418:head, will try copies on 3,4 2024-09-17T16:42:18.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 355 15 4803627 4803612 845.629 794.75 0.000807534 0.00117182 2024-09-17T16:42:18.774 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.772+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:42:18.778 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.776+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b2da05fa:::benchmark_data_smithi165_34272_object2824:head, will try copies on 2,3 2024-09-17T16:42:18.794 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.792+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ea447c:::benchmark_data_smithi165_34272_object4231:head, will try copies on 3,4 2024-09-17T16:42:18.801 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.799+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95fd8b26:::benchmark_data_smithi165_34272_object1024:head, will try copies on 0,4 2024-09-17T16:42:18.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.800+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29d32a1c:::benchmark_data_smithi165_34272_object2719:head, will try copies on 0,4 2024-09-17T16:42:18.814 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.811+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:42:18.819 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.816+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:694da304:::benchmark_data_smithi165_34272_object4069:head, will try copies on 3,4 2024-09-17T16:42:18.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.835+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd1a0155:::benchmark_data_smithi165_34272_object2925:head, will try copies on 2,3 2024-09-17T16:42:18.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.840+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:42:18.850 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.847+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fb5768d:::benchmark_data_smithi165_34272_object1913:head, will try copies on 0,4 2024-09-17T16:42:18.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.856+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:42:18.874 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.872+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:42:18.905 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.902+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:95749fe2:::benchmark_data_smithi165_34272_object2042:head, will try copies on 0,4 2024-09-17T16:42:18.906 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.904+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4f5c684:::benchmark_data_smithi165_34272_object3813:head, will try copies on 2,3 2024-09-17T16:42:18.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.932+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:42:18.940 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.938+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf15bf76:::benchmark_data_smithi165_34272_object2998:head, will try copies on 2,3 2024-09-17T16:42:18.952 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.947+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5cbfdd82:::benchmark_data_smithi165_34272_object1176:head, will try copies on 3,4 2024-09-17T16:42:18.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.962+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6694d37f:::benchmark_data_smithi165_34272_object2975:head, will try copies on 3,4 2024-09-17T16:42:18.967 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.964+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2447bb88:::benchmark_data_smithi165_34272_object204:head, will try copies on 0,4 2024-09-17T16:42:18.983 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.980+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1a31dbe:::benchmark_data_smithi165_34272_object1905:head, will try copies on 2,3 2024-09-17T16:42:18.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.982+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:42:18.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:18.994+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f87fc18:::benchmark_data_smithi165_34272_object3773:head, will try copies on 0,4 2024-09-17T16:42:19.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.012+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:669fc437:::benchmark_data_smithi165_34272_object2844:head, will try copies on 3,4 2024-09-17T16:42:19.041 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.038+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60189d75:::benchmark_data_smithi165_34272_object1428:head, will try copies on 3,4 2024-09-17T16:42:19.047 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.044+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f912fb1:::benchmark_data_smithi165_34272_object697:head, will try copies on 3,4 2024-09-17T16:42:19.058 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.055+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:42:19.082 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.079+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67aa773c:::benchmark_data_smithi165_34272_object3091:head, will try copies on 3,4 2024-09-17T16:42:19.085 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.082+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:579ac4de:::benchmark_data_smithi165_34272_object27:head, will try copies on 3,4 2024-09-17T16:42:19.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.088+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d6d3b90:::benchmark_data_smithi165_34272_object1528:head, will try copies on 0,4 2024-09-17T16:42:19.113 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.110+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:42:19.141 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.138+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:966f7d11:::benchmark_data_smithi165_34272_object4310:head, will try copies on 0,4 2024-09-17T16:42:19.187 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.183+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5329d27e:::benchmark_data_smithi165_34272_object3651:head, will try copies on 3,4 2024-09-17T16:42:19.194 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.191+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26709935:::benchmark_data_smithi165_34272_object770:head, will try copies on 0,4 2024-09-17T16:42:19.196 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.192+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:42:19.209 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.205+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8ae52a:::benchmark_data_smithi165_34272_object2783:head, will try copies on 3,4 2024-09-17T16:42:19.229 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.225+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d5fedbb:::benchmark_data_smithi165_34272_object2214:head, will try copies on 3,4 2024-09-17T16:42:19.234 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.231+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20d33b80:::benchmark_data_smithi165_34272_object551:head, will try copies on 0,4 2024-09-17T16:42:19.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.245+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:42:19.259 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.256+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:240b8462:::benchmark_data_smithi165_34272_object1220:head, will try copies on 0,4 2024-09-17T16:42:19.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.267+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:525ffe0c:::benchmark_data_smithi165_34272_object346:head, will try copies on 3,4 2024-09-17T16:42:19.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.272+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d4af0c:::benchmark_data_smithi165_34272_object1970:head, will try copies on 0,4 2024-09-17T16:42:19.281 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.278+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67e24294:::benchmark_data_smithi165_34272_object1338:head, will try copies on 3,4 2024-09-17T16:42:19.283 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.280+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bbc161de:::benchmark_data_smithi165_34272_object898:head, will try copies on 2,3 2024-09-17T16:42:19.300 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.296+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:939bca9b:::benchmark_data_smithi165_34272_object1908:head, will try copies on 0,4 2024-09-17T16:42:19.301 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.298+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25ad6c18:::benchmark_data_smithi165_34272_object2945:head, will try copies on 0,4 2024-09-17T16:42:19.333 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.330+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:91032ba9:::benchmark_data_smithi165_34272_object3623:head, will try copies on 0,4 2024-09-17T16:42:19.339 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.336+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:502072a5:::benchmark_data_smithi165_34272_object3271:head, will try copies on 3,4 2024-09-17T16:42:19.364 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.361+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:42:19.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.362+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:576b081f:::benchmark_data_smithi165_34272_object63:head, will try copies on 3,4 2024-09-17T16:42:19.365 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.362+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b73c669:::benchmark_data_smithi165_34272_object1948:head, will try copies on 3,4 2024-09-17T16:42:19.388 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.385+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9326a865:::benchmark_data_smithi165_34272_object2262:head, will try copies on 0,4 2024-09-17T16:42:19.392 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.389+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:42:19.409 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.406+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5df10f0d:::benchmark_data_smithi165_34272_object462:head, will try copies on 3,4 2024-09-17T16:42:19.411 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.408+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3f7daa4:::benchmark_data_smithi165_34272_object2889:head, will try copies on 2,3 2024-09-17T16:42:19.444 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.440+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9786a1f7:::benchmark_data_smithi165_34272_object2171:head, will try copies on 0,4 2024-09-17T16:42:19.448 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.445+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69e7a8bb:::benchmark_data_smithi165_34272_object2165:head, will try copies on 3,4 2024-09-17T16:42:19.461 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.458+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:42:19.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.467+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f1be31b:::benchmark_data_smithi165_34272_object1045:head, will try copies on 3,4 2024-09-17T16:42:19.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.468+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ea31f6f:::benchmark_data_smithi165_34272_object2495:head, will try copies on 0,4 2024-09-17T16:42:19.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.481+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:42:19.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.484+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b174df80:::benchmark_data_smithi165_34272_object254:head, will try copies on 2,3 2024-09-17T16:42:19.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.504+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:42:19.508 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.504+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:292c2c04:::benchmark_data_smithi165_34272_object2805:head, will try copies on 0,4 2024-09-17T16:42:19.544 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.541+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b0dc637a:::benchmark_data_smithi165_34272_object3449:head, will try copies on 2,3 2024-09-17T16:42:19.560 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.556+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54dbc968:::benchmark_data_smithi165_34272_object2620:head, will try copies on 3,4 2024-09-17T16:42:19.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.559+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:42:19.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.576+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9dc54aa4:::benchmark_data_smithi165_34272_object975:head, will try copies on 0,4 2024-09-17T16:42:19.586 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.583+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:649bc5be:::benchmark_data_smithi165_34272_object3311:head, will try copies on 3,4 2024-09-17T16:42:19.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.607+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2379e8e9:::benchmark_data_smithi165_34272_object411:head, will try copies on 0,4 2024-09-17T16:42:19.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.611+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:42:19.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.616+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b87c0af7:::benchmark_data_smithi165_34272_object2985:head, will try copies on 2,3 2024-09-17T16:42:19.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.629+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22fd94af:::benchmark_data_smithi165_34272_object4194:head, will try copies on 0,4 2024-09-17T16:42:19.637 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.629+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68c4de46:::benchmark_data_smithi165_34272_object3158:head, will try copies on 3,4 2024-09-17T16:42:19.648 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.644+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:42:19.650 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.647+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2448d19a:::benchmark_data_smithi165_34272_object3039:head, will try copies on 0,4 2024-09-17T16:42:19.659 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.656+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54fd392f:::benchmark_data_smithi165_34272_object2016:head, will try copies on 3,4 2024-09-17T16:42:19.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.670+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be8cb096:::benchmark_data_smithi165_34272_object2584:head, will try copies on 2,3 2024-09-17T16:42:19.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.676+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62d7054c:::benchmark_data_smithi165_34272_object421:head, will try copies on 3,4 2024-09-17T16:42:19.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.676+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:926cad0f:::benchmark_data_smithi165_34272_object4128:head, will try copies on 0,4 2024-09-17T16:42:19.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.697+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e7530b:::benchmark_data_smithi165_34272_object1553:head, will try copies on 3,4 2024-09-17T16:42:19.709 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.706+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b4c24a4:::benchmark_data_smithi165_34272_object1095:head, will try copies on 3,4 2024-09-17T16:42:19.718 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.714+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b084462b:::benchmark_data_smithi165_34272_object308:head, will try copies on 2,3 2024-09-17T16:42:19.728 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.725+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f95f325:::benchmark_data_smithi165_34272_object4111:head, will try copies on 0,4 2024-09-17T16:42:19.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.748+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:599c1105:::benchmark_data_smithi165_34272_object771:head, will try copies on 3,4 2024-09-17T16:42:19.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 356 16 4817360 4817344 845.664 858.25 0.000672978 0.00117176 2024-09-17T16:42:19.779 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.776+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a92b417:::benchmark_data_smithi165_34272_object965:head, will try copies on 0,4 2024-09-17T16:42:19.781 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.778+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53f9e11d:::benchmark_data_smithi165_34272_object2144:head, will try copies on 3,4 2024-09-17T16:42:19.802 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.799+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:22ca4cf3:::benchmark_data_smithi165_34272_object2301:head, will try copies on 0,4 2024-09-17T16:42:19.803 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.800+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96279841:::benchmark_data_smithi165_34272_object1731:head, will try copies on 0,4 2024-09-17T16:42:19.815 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.812+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf022172:::benchmark_data_smithi165_34272_object2708:head, will try copies on 2,3 2024-09-17T16:42:19.842 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.839+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:613a71e6:::benchmark_data_smithi165_34272_object3361:head, will try copies on 3,4 2024-09-17T16:42:19.854 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.850+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f69177:::benchmark_data_smithi165_34272_object2976:head, will try copies on 0,4 2024-09-17T16:42:19.859 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.856+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6be08702:::benchmark_data_smithi165_34272_object350:head, will try copies on 3,4 2024-09-17T16:42:19.865 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.861+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5798c961:::benchmark_data_smithi165_34272_object4297:head, will try copies on 3,4 2024-09-17T16:42:19.882 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.879+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:42:19.885 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.882+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b4a2d3ca:::benchmark_data_smithi165_34272_object983:head, will try copies on 2,3 2024-09-17T16:42:19.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.896+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632dd3b8:::benchmark_data_smithi165_34272_object729:head, will try copies on 3,4 2024-09-17T16:42:19.915 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.912+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:552c878c:::benchmark_data_smithi165_34272_object519:head, will try copies on 3,4 2024-09-17T16:42:19.922 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.919+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2e94facb:::benchmark_data_smithi165_34272_object3896:head, will try copies on 0,4 2024-09-17T16:42:19.934 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.931+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63fffd4d:::benchmark_data_smithi165_34272_object412:head, will try copies on 3,4 2024-09-17T16:42:19.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.947+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57c53cce:::benchmark_data_smithi165_34272_object76:head, will try copies on 3,4 2024-09-17T16:42:19.957 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.954+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:42:19.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.966+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:42:19.976 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:19.973+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ca32b2c:::benchmark_data_smithi165_34272_object3788:head, will try copies on 0,4 2024-09-17T16:42:20.016 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.013+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8094051:::benchmark_data_smithi165_34272_object2530:head, will try copies on 2,3 2024-09-17T16:42:20.028 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.024+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9fe35053:::benchmark_data_smithi165_34272_object236:head, will try copies on 0,4 2024-09-17T16:42:20.031 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.028+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:42:20.052 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.048+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:42:20.053 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.050+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:90a49004:::benchmark_data_smithi165_34272_object2175:head, will try copies on 0,4 2024-09-17T16:42:20.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.062+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bb63da0:::benchmark_data_smithi165_34272_object3435:head, will try copies on 3,4 2024-09-17T16:42:20.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.071+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba8833f:::benchmark_data_smithi165_34272_object2450:head, will try copies on 3,4 2024-09-17T16:42:20.087 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.084+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:42:20.088 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.085+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96035266:::benchmark_data_smithi165_34272_object1787:head, will try copies on 0,4 2024-09-17T16:42:20.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.114+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2367eda5:::benchmark_data_smithi165_34272_object156:head, will try copies on 0,4 2024-09-17T16:42:20.124 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.121+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:42:20.138 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.135+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9c2103f7:::benchmark_data_smithi165_34272_object1311:head, will try copies on 0,4 2024-09-17T16:42:20.148 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.145+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3448c7:::benchmark_data_smithi165_34272_object319:head, will try copies on 2,3 2024-09-17T16:42:20.152 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.149+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d784296:::benchmark_data_smithi165_34272_object3665:head, will try copies on 3,4 2024-09-17T16:42:20.165 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.161+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:42:20.198 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.194+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f8ecf88:::benchmark_data_smithi165_34272_object3009:head, will try copies on 3,4 2024-09-17T16:42:20.216 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.213+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:952de1c3:::benchmark_data_smithi165_34272_object2993:head, will try copies on 0,4 2024-09-17T16:42:20.226 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.222+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6816ae42:::benchmark_data_smithi165_34272_object1547:head, will try copies on 3,4 2024-09-17T16:42:20.239 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.236+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:907a215f:::benchmark_data_smithi165_34272_object3165:head, will try copies on 0,4 2024-09-17T16:42:20.240 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.236+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e772cd7:::benchmark_data_smithi165_34272_object4055:head, will try copies on 3,4 2024-09-17T16:42:20.255 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.252+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b4ae343:::benchmark_data_smithi165_34272_object2128:head, will try copies on 3,4 2024-09-17T16:42:20.274 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.271+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b28db435:::benchmark_data_smithi165_34272_object2865:head, will try copies on 2,3 2024-09-17T16:42:20.280 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.277+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:42:20.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.288+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1f201df:::benchmark_data_smithi165_34272_object2471:head, will try copies on 2,3 2024-09-17T16:42:20.293 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.290+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b45f1a3:::benchmark_data_smithi165_34272_object2592:head, will try copies on 3,4 2024-09-17T16:42:20.303 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.299+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:944afc7b:::benchmark_data_smithi165_34272_object3251:head, will try copies on 0,4 2024-09-17T16:42:20.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.326+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6962b47c:::benchmark_data_smithi165_34272_object1094:head, will try copies on 3,4 2024-09-17T16:42:20.329 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.326+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b07f3872:::benchmark_data_smithi165_34272_object3573:head, will try copies on 2,3 2024-09-17T16:42:20.345 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.342+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:559b4c3a:::benchmark_data_smithi165_34272_object1422:head, will try copies on 3,4 2024-09-17T16:42:20.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.366+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:42:20.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.378+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:562f716a:::benchmark_data_smithi165_34272_object3654:head, will try copies on 3,4 2024-09-17T16:42:20.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.385+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2769adcb:::benchmark_data_smithi165_34272_object1812:head, will try copies on 0,4 2024-09-17T16:42:20.406 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.403+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e36edb6:::benchmark_data_smithi165_34272_object3635:head, will try copies on 3,4 2024-09-17T16:42:20.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.410+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9e0551de:::benchmark_data_smithi165_34272_object366:head, will try copies on 0,4 2024-09-17T16:42:20.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.429+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9513685d:::benchmark_data_smithi165_34272_object174:head, will try copies on 0,4 2024-09-17T16:42:20.435 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.432+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:42:20.440 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.436+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2bc129f1:::benchmark_data_smithi165_34272_object4396:head, will try copies on 0,4 2024-09-17T16:42:20.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.455+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:42:20.474 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.471+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b862fe23:::benchmark_data_smithi165_34272_object3028:head, will try copies on 2,3 2024-09-17T16:42:20.477 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.474+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9507e1fa:::benchmark_data_smithi165_34272_object1141:head, will try copies on 0,4 2024-09-17T16:42:20.482 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.479+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e56e6a6:::benchmark_data_smithi165_34272_object78:head, will try copies on 3,4 2024-09-17T16:42:20.491 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.488+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29a05a26:::benchmark_data_smithi165_34272_object185:head, will try copies on 0,4 2024-09-17T16:42:20.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.489+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6c485e81:::benchmark_data_smithi165_34272_object3644:head, will try copies on 3,4 2024-09-17T16:42:20.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.496+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5fa598d:::benchmark_data_smithi165_34272_object2334:head, will try copies on 2,3 2024-09-17T16:42:20.502 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.499+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cfddf0c:::benchmark_data_smithi165_34272_object2404:head, will try copies on 0,4 2024-09-17T16:42:20.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.521+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2623b245:::benchmark_data_smithi165_34272_object3559:head, will try copies on 0,4 2024-09-17T16:42:20.546 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.543+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c521c12:::benchmark_data_smithi165_34272_object340:head, will try copies on 3,4 2024-09-17T16:42:20.552 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.548+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9af91514:::benchmark_data_smithi165_34272_object1339:head, will try copies on 0,4 2024-09-17T16:42:20.561 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.557+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:67cce25c:::benchmark_data_smithi165_34272_object2441:head, will try copies on 3,4 2024-09-17T16:42:20.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.570+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6063c44:::benchmark_data_smithi165_34272_object2658:head, will try copies on 2,3 2024-09-17T16:42:20.583 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.580+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b8d70dc:::benchmark_data_smithi165_34272_object1660:head, will try copies on 3,4 2024-09-17T16:42:20.595 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.591+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:982ab9a6:::benchmark_data_smithi165_34272_object1217:head, will try copies on 0,4 2024-09-17T16:42:20.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.597+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5f757e7a:::benchmark_data_smithi165_34272_object4556:head, will try copies on 3,4 2024-09-17T16:42:20.611 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.608+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b107bd4d:::benchmark_data_smithi165_34272_object820:head, will try copies on 2,3 2024-09-17T16:42:20.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.637+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a4172de:::benchmark_data_smithi165_34272_object3453:head, will try copies on 3,4 2024-09-17T16:42:20.662 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.658+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:59189c9a:::benchmark_data_smithi165_34272_object3244:head, will try copies on 3,4 2024-09-17T16:42:20.674 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.670+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:42:20.689 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.686+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:42:20.692 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.689+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:539e0835:::benchmark_data_smithi165_34272_object2629:head, will try copies on 3,4 2024-09-17T16:42:20.694 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.691+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26de9ab4:::benchmark_data_smithi165_34272_object2905:head, will try copies on 0,4 2024-09-17T16:42:20.703 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.699+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:42:20.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.713+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bdca580:::benchmark_data_smithi165_34272_object2996:head, will try copies on 3,4 2024-09-17T16:42:20.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 357 16 4830379 4830363 845.575 813.688 0.000444773 0.00117174 2024-09-17T16:42:20.846 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.843+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:42:20.857 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.854+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68eb61a2:::benchmark_data_smithi165_34272_object2914:head, will try copies on 3,4 2024-09-17T16:42:20.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.897+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2073e625:::benchmark_data_smithi165_34272_object3627:head, will try copies on 0,4 2024-09-17T16:42:20.914 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.911+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bcef1a1:::benchmark_data_smithi165_34272_object2201:head, will try copies on 0,4 2024-09-17T16:42:20.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.923+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5867fae1:::benchmark_data_smithi165_34272_object2598:head, will try copies on 3,4 2024-09-17T16:42:20.944 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.941+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:249edae9:::benchmark_data_smithi165_34272_object2058:head, will try copies on 0,4 2024-09-17T16:42:20.965 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.961+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e309fb0:::benchmark_data_smithi165_34272_object1276:head, will try copies on 3,4 2024-09-17T16:42:20.980 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.977+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:981a59bb:::benchmark_data_smithi165_34272_object1902:head, will try copies on 0,4 2024-09-17T16:42:20.985 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.982+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:251017b5:::benchmark_data_smithi165_34272_object242:head, will try copies on 0,4 2024-09-17T16:42:20.997 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.994+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51ded0d2:::benchmark_data_smithi165_34272_object329:head, will try copies on 3,4 2024-09-17T16:42:20.998 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.995+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:685c65a3:::benchmark_data_smithi165_34272_object768:head, will try copies on 3,4 2024-09-17T16:42:21.001 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:20.997+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:42:21.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.008+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb3b5189:::benchmark_data_smithi165_34272_object4564:head, will try copies on 2,3 2024-09-17T16:42:21.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.008+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29538382:::benchmark_data_smithi165_34272_object1215:head, will try copies on 0,4 2024-09-17T16:42:21.068 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.064+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93f4cba7:::benchmark_data_smithi165_34272_object2464:head, will try copies on 0,4 2024-09-17T16:42:21.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.103+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:57e4044c:::benchmark_data_smithi165_34272_object988:head, will try copies on 3,4 2024-09-17T16:42:21.134 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.130+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51633637:::benchmark_data_smithi165_34272_object2682:head, will try copies on 3,4 2024-09-17T16:42:21.149 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.145+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27c9632a:::benchmark_data_smithi165_34272_object2814:head, will try copies on 0,4 2024-09-17T16:42:21.160 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.157+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ec9731d:::benchmark_data_smithi165_34272_object2258:head, will try copies on 0,4 2024-09-17T16:42:21.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.167+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e663f71:::benchmark_data_smithi165_34272_object1052:head, will try copies on 3,4 2024-09-17T16:42:21.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.171+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23a98c52:::benchmark_data_smithi165_34272_object761:head, will try copies on 0,4 2024-09-17T16:42:21.183 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.179+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995bb435:::benchmark_data_smithi165_34272_object3502:head, will try copies on 0,4 2024-09-17T16:42:21.200 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.196+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e1c5599:::benchmark_data_smithi165_34272_object1984:head, will try copies on 3,4 2024-09-17T16:42:21.201 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.198+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:42:21.202 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.199+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b7bfc22:::benchmark_data_smithi165_34272_object1936:head, will try copies on 0,4 2024-09-17T16:42:21.212 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.209+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:42:21.224 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.221+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9913d6df:::benchmark_data_smithi165_34272_object847:head, will try copies on 0,4 2024-09-17T16:42:21.235 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.231+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:42:21.248 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.245+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273c110f:::benchmark_data_smithi165_34272_object3779:head, will try copies on 0,4 2024-09-17T16:42:21.271 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.267+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52783dfa:::benchmark_data_smithi165_34272_object1751:head, will try copies on 3,4 2024-09-17T16:42:21.282 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.278+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bd21d5ea:::benchmark_data_smithi165_34272_object2543:head, will try copies on 2,3 2024-09-17T16:42:21.284 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.281+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:21f24efa:::benchmark_data_smithi165_34272_object1299:head, will try copies on 0,4 2024-09-17T16:42:21.291 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.288+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5143fca7:::benchmark_data_smithi165_34272_object1295:head, will try copies on 3,4 2024-09-17T16:42:21.307 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.303+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6780657:::benchmark_data_smithi165_34272_object3168:head, will try copies on 2,3 2024-09-17T16:42:21.316 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.313+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94517e7f:::benchmark_data_smithi165_34272_object3334:head, will try copies on 0,4 2024-09-17T16:42:21.330 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.326+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2ceab8a9:::benchmark_data_smithi165_34272_object3765:head, will try copies on 0,4 2024-09-17T16:42:21.352 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.349+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d72fb90:::benchmark_data_smithi165_34272_object3423:head, will try copies on 0,4 2024-09-17T16:42:21.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.357+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63409a8d:::benchmark_data_smithi165_34272_object3509:head, will try copies on 3,4 2024-09-17T16:42:21.375 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.371+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:29820cc9:::benchmark_data_smithi165_34272_object4098:head, will try copies on 0,4 2024-09-17T16:42:21.377 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.373+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a10d798:::benchmark_data_smithi165_34272_object758:head, will try copies on 0,4 2024-09-17T16:42:21.381 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.378+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:68241951:::benchmark_data_smithi165_34272_object3918:head, will try copies on 3,4 2024-09-17T16:42:21.399 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.396+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5de66890:::benchmark_data_smithi165_34272_object577:head, will try copies on 3,4 2024-09-17T16:42:21.413 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.410+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66bc65cd:::benchmark_data_smithi165_34272_object2436:head, will try copies on 3,4 2024-09-17T16:42:21.415 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.411+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27215ee7:::benchmark_data_smithi165_34272_object642:head, will try copies on 0,4 2024-09-17T16:42:21.423 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.420+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9600b771:::benchmark_data_smithi165_34272_object868:head, will try copies on 0,4 2024-09-17T16:42:21.441 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.438+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:42:21.446 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.443+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60f6665a:::benchmark_data_smithi165_34272_object1743:head, will try copies on 3,4 2024-09-17T16:42:21.451 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.448+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1341279:::benchmark_data_smithi165_34272_object2095:head, will try copies on 2,3 2024-09-17T16:42:21.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.459+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fc62c0a:::benchmark_data_smithi165_34272_object1836:head, will try copies on 0,4 2024-09-17T16:42:21.471 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.468+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:62aaf442:::benchmark_data_smithi165_34272_object337:head, will try copies on 3,4 2024-09-17T16:42:21.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.483+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9bdad489:::benchmark_data_smithi165_34272_object1914:head, will try copies on 0,4 2024-09-17T16:42:21.488 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.485+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52bcdeee:::benchmark_data_smithi165_34272_object1781:head, will try copies on 3,4 2024-09-17T16:42:21.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.488+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b538ddd9:::benchmark_data_smithi165_34272_object2711:head, will try copies on 2,3 2024-09-17T16:42:21.498 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.494+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6d8718db:::benchmark_data_smithi165_34272_object482:head, will try copies on 3,4 2024-09-17T16:42:21.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.505+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:20b80b14:::benchmark_data_smithi165_34272_object3263:head, will try copies on 0,4 2024-09-17T16:42:21.509 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.505+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:98faf4c7:::benchmark_data_smithi165_34272_object646:head, will try copies on 0,4 2024-09-17T16:42:21.538 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.534+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:527e5426:::benchmark_data_smithi165_34272_object2252:head, will try copies on 3,4 2024-09-17T16:42:21.564 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.561+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6cfd0497:::benchmark_data_smithi165_34272_object1800:head, will try copies on 3,4 2024-09-17T16:42:21.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.571+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b579c1e:::benchmark_data_smithi165_34272_object1362:head, will try copies on 3,4 2024-09-17T16:42:21.580 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.577+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b79f047d:::benchmark_data_smithi165_34272_object2135:head, will try copies on 2,3 2024-09-17T16:42:21.582 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.579+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60a7746d:::benchmark_data_smithi165_34272_object1099:head, will try copies on 3,4 2024-09-17T16:42:21.600 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.597+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:532f8f81:::benchmark_data_smithi165_34272_object1594:head, will try copies on 3,4 2024-09-17T16:42:21.625 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.622+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e2e904:::benchmark_data_smithi165_34272_object4230:head, will try copies on 2,3 2024-09-17T16:42:21.627 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.624+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58e8b6f4:::benchmark_data_smithi165_34272_object2281:head, will try copies on 3,4 2024-09-17T16:42:21.646 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.643+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba996a3c:::benchmark_data_smithi165_34272_object3843:head, will try copies on 2,3 2024-09-17T16:42:21.672 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.668+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51e91b98:::benchmark_data_smithi165_34272_object1329:head, will try copies on 3,4 2024-09-17T16:42:21.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.680+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b7b3dfe:::benchmark_data_smithi165_34272_object2612:head, will try copies on 0,4 2024-09-17T16:42:21.688 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.684+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:289587e5:::benchmark_data_smithi165_34272_object2211:head, will try copies on 0,4 2024-09-17T16:42:21.698 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.695+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9352c9bd:::benchmark_data_smithi165_34272_object2216:head, will try copies on 0,4 2024-09-17T16:42:21.699 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.696+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b73e317f:::benchmark_data_smithi165_34272_object745:head, will try copies on 2,3 2024-09-17T16:42:21.716 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.712+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c640469:::benchmark_data_smithi165_34272_object977:head, will try copies on 3,4 2024-09-17T16:42:21.721 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.717+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69cbaf2f:::benchmark_data_smithi165_34272_object2126:head, will try copies on 3,4 2024-09-17T16:42:21.741 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.738+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2eb3ddfc:::benchmark_data_smithi165_34272_object2831:head, will try copies on 0,4 2024-09-17T16:42:21.751 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.748+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cc87123:::benchmark_data_smithi165_34272_object527:head, will try copies on 0,4 2024-09-17T16:42:21.758 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.755+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60990c84:::benchmark_data_smithi165_34272_object142:head, will try copies on 3,4 2024-09-17T16:42:21.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 358 15 4843406 4843391 845.487 814.25 0.00095907 0.00117201 2024-09-17T16:42:21.770 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.766+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bad2b746:::benchmark_data_smithi165_34272_object3594:head, will try copies on 2,3 2024-09-17T16:42:21.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.771+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:236ae646:::benchmark_data_smithi165_34272_object908:head, will try copies on 0,4 2024-09-17T16:42:21.775 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.771+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:992d5e41:::benchmark_data_smithi165_34272_object4130:head, will try copies on 0,4 2024-09-17T16:42:21.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.780+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6f25c8d2:::benchmark_data_smithi165_34272_object2308:head, will try copies on 3,4 2024-09-17T16:42:21.783 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.780+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50ad3a80:::benchmark_data_smithi165_34272_object2329:head, will try copies on 3,4 2024-09-17T16:42:21.825 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.821+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9b85b8d7:::benchmark_data_smithi165_34272_object1802:head, will try copies on 0,4 2024-09-17T16:42:21.831 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.828+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:570a8885:::benchmark_data_smithi165_34272_object2802:head, will try copies on 3,4 2024-09-17T16:42:21.838 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.834+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:42:21.861 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.858+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:94b59d4b:::benchmark_data_smithi165_34272_object288:head, will try copies on 0,4 2024-09-17T16:42:21.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.859+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6657ff4a:::benchmark_data_smithi165_34272_object1691:head, will try copies on 3,4 2024-09-17T16:42:21.863 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.860+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bda8b94f:::benchmark_data_smithi165_34272_object292:head, will try copies on 2,3 2024-09-17T16:42:21.873 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.870+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b070ace:::benchmark_data_smithi165_34272_object2731:head, will try copies on 3,4 2024-09-17T16:42:21.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.897+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2905144c:::benchmark_data_smithi165_34272_object1119:head, will try copies on 0,4 2024-09-17T16:42:21.921 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.917+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9cceb78e:::benchmark_data_smithi165_34272_object3802:head, will try copies on 0,4 2024-09-17T16:42:21.926 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.923+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:516dd626:::benchmark_data_smithi165_34272_object4504:head, will try copies on 3,4 2024-09-17T16:42:21.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.934+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5aa0e8c:::benchmark_data_smithi165_34272_object3204:head, will try copies on 2,3 2024-09-17T16:42:21.950 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.947+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58cbbce2:::benchmark_data_smithi165_34272_object2335:head, will try copies on 3,4 2024-09-17T16:42:21.961 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.958+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d558e4c:::benchmark_data_smithi165_34272_object1972:head, will try copies on 0,4 2024-09-17T16:42:21.970 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.967+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:60d139e8:::benchmark_data_smithi165_34272_object3634:head, will try copies on 3,4 2024-09-17T16:42:21.979 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.976+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58a681e9:::benchmark_data_smithi165_34272_object3446:head, will try copies on 3,4 2024-09-17T16:42:21.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.990+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b089bd6d:::benchmark_data_smithi165_34272_object3231:head, will try copies on 2,3 2024-09-17T16:42:21.993 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:21.990+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9696f84d:::benchmark_data_smithi165_34272_object2890:head, will try copies on 0,4 2024-09-17T16:42:22.009 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.006+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b86f7014:::benchmark_data_smithi165_34272_object4270:head, will try copies on 2,3 2024-09-17T16:42:22.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.009+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cf0d5e9:::benchmark_data_smithi165_34272_object1987:head, will try copies on 0,4 2024-09-17T16:42:22.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.052+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d01bf51:::benchmark_data_smithi165_34272_object4182:head, will try copies on 0,4 2024-09-17T16:42:22.065 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.062+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:23f8a2cf:::benchmark_data_smithi165_34272_object2987:head, will try copies on 0,4 2024-09-17T16:42:22.072 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.069+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:55101a0f:::benchmark_data_smithi165_34272_object299:head, will try copies on 3,4 2024-09-17T16:42:22.089 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.086+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b6e5cd2:::benchmark_data_smithi165_34272_object489:head, will try copies on 0,4 2024-09-17T16:42:22.116 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.113+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3d1cd89:::benchmark_data_smithi165_34272_object296:head, will try copies on 2,3 2024-09-17T16:42:22.118 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.115+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:273f29c9:::benchmark_data_smithi165_34272_object3945:head, will try copies on 0,4 2024-09-17T16:42:22.120 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.117+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c3dc1b9:::benchmark_data_smithi165_34272_object3421:head, will try copies on 3,4 2024-09-17T16:42:22.139 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.136+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6637dcdd:::benchmark_data_smithi165_34272_object806:head, will try copies on 3,4 2024-09-17T16:42:22.146 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.143+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:983b4148:::benchmark_data_smithi165_34272_object4084:head, will try copies on 0,4 2024-09-17T16:42:22.155 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.152+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcd5543c:::benchmark_data_smithi165_34272_object2797:head, will try copies on 2,3 2024-09-17T16:42:22.166 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.163+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6af62f06:::benchmark_data_smithi165_34272_object2517:head, will try copies on 3,4 2024-09-17T16:42:22.170 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.167+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27cee75d:::benchmark_data_smithi165_34272_object3864:head, will try copies on 0,4 2024-09-17T16:42:22.185 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.181+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5a3358a7:::benchmark_data_smithi165_34272_object2742:head, will try copies on 3,4 2024-09-17T16:42:22.195 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.192+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb72fe17:::benchmark_data_smithi165_34272_object3019:head, will try copies on 2,3 2024-09-17T16:42:22.205 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.201+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b97b9d4:::benchmark_data_smithi165_34272_object3832:head, will try copies on 3,4 2024-09-17T16:42:22.213 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.210+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9ed8cc04:::benchmark_data_smithi165_34272_object685:head, will try copies on 0,4 2024-09-17T16:42:22.244 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.240+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:935c74b2:::benchmark_data_smithi165_34272_object2547:head, will try copies on 0,4 2024-09-17T16:42:22.250 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.247+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b820f256:::benchmark_data_smithi165_34272_object3928:head, will try copies on 2,3 2024-09-17T16:42:22.256 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.253+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6eeb52cd:::benchmark_data_smithi165_34272_object2875:head, will try copies on 3,4 2024-09-17T16:42:22.262 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.259+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97ad49ad:::benchmark_data_smithi165_34272_object4005:head, will try copies on 0,4 2024-09-17T16:42:22.270 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.266+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5b99c27d:::benchmark_data_smithi165_34272_object325:head, will try copies on 3,4 2024-09-17T16:42:22.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.282+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65030c0b:::benchmark_data_smithi165_34272_object608:head, will try copies on 3,4 2024-09-17T16:42:22.317 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.313+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2016b809:::benchmark_data_smithi165_34272_object454:head, will try copies on 0,4 2024-09-17T16:42:22.320 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.317+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:42:22.324 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.321+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96dccc32:::benchmark_data_smithi165_34272_object4281:head, will try copies on 0,4 2024-09-17T16:42:22.344 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.341+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e88bd96:::benchmark_data_smithi165_34272_object893:head, will try copies on 3,4 2024-09-17T16:42:22.360 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.357+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b193225:::benchmark_data_smithi165_34272_object625:head, will try copies on 0,4 2024-09-17T16:42:22.376 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.373+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d8f093a:::benchmark_data_smithi165_34272_object1910:head, will try copies on 0,4 2024-09-17T16:42:22.393 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.390+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6b6b623b:::benchmark_data_smithi165_34272_object3829:head, will try copies on 3,4 2024-09-17T16:42:22.395 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.392+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b3735f7b:::benchmark_data_smithi165_34272_object1164:head, will try copies on 2,3 2024-09-17T16:42:22.420 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.417+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:632f462b:::benchmark_data_smithi165_34272_object3442:head, will try copies on 3,4 2024-09-17T16:42:22.429 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.426+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:24116f34:::benchmark_data_smithi165_34272_object4349:head, will try copies on 0,4 2024-09-17T16:42:22.431 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.427+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b82186b7:::benchmark_data_smithi165_34272_object2881:head, will try copies on 2,3 2024-09-17T16:42:22.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.429+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93d5ff75:::benchmark_data_smithi165_34272_object1078:head, will try copies on 0,4 2024-09-17T16:42:22.434 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.431+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54da8bc2:::benchmark_data_smithi165_34272_object77:head, will try copies on 3,4 2024-09-17T16:42:22.443 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.439+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63b20d21:::benchmark_data_smithi165_34272_object2720:head, will try copies on 3,4 2024-09-17T16:42:22.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.456+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b6e898b5:::benchmark_data_smithi165_34272_object3148:head, will try copies on 2,3 2024-09-17T16:42:22.485 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.482+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28c49e65:::benchmark_data_smithi165_34272_object1354:head, will try copies on 0,4 2024-09-17T16:42:22.492 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.488+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb66ab88:::benchmark_data_smithi165_34272_object614:head, will try copies on 2,3 2024-09-17T16:42:22.505 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.501+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d40c166:::benchmark_data_smithi165_34272_object2509:head, will try copies on 0,4 2024-09-17T16:42:22.513 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.510+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ba3479d:::benchmark_data_smithi165_34272_object427:head, will try copies on 3,4 2024-09-17T16:42:22.515 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.512+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6bbb8db8:::benchmark_data_smithi165_34272_object1040:head, will try copies on 3,4 2024-09-17T16:42:22.524 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.521+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b9a93380:::benchmark_data_smithi165_34272_object3197:head, will try copies on 2,3 2024-09-17T16:42:22.534 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.530+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54c6cf6b:::benchmark_data_smithi165_34272_object1722:head, will try copies on 3,4 2024-09-17T16:42:22.569 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.565+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:50d9fb1d:::benchmark_data_smithi165_34272_object1626:head, will try copies on 3,4 2024-09-17T16:42:22.574 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.570+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1d94159:::benchmark_data_smithi165_34272_object12:head, will try copies on 2,3 2024-09-17T16:42:22.578 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.575+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:644372a9:::benchmark_data_smithi165_34272_object2778:head, will try copies on 3,4 2024-09-17T16:42:22.584 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.581+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2955cd8e:::benchmark_data_smithi165_34272_object902:head, will try copies on 0,4 2024-09-17T16:42:22.618 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.615+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:226e7e3d:::benchmark_data_smithi165_34272_object3855:head, will try copies on 0,4 2024-09-17T16:42:22.624 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.621+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9a9ddf27:::benchmark_data_smithi165_34272_object3521:head, will try copies on 0,4 2024-09-17T16:42:22.640 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.637+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b44440:::benchmark_data_smithi165_34272_object2609:head, will try copies on 3,4 2024-09-17T16:42:22.644 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.641+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:995b9ade:::benchmark_data_smithi165_34272_object2046:head, will try copies on 0,4 2024-09-17T16:42:22.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.660+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5ff314de:::benchmark_data_smithi165_34272_object3814:head, will try copies on 3,4 2024-09-17T16:42:22.673 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.670+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:901a3203:::benchmark_data_smithi165_34272_object4323:head, will try copies on 0,4 2024-09-17T16:42:22.681 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.678+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6711c6c4:::benchmark_data_smithi165_34272_object1285:head, will try copies on 3,4 2024-09-17T16:42:22.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.679+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c999c52:::benchmark_data_smithi165_34272_object361:head, will try copies on 3,4 2024-09-17T16:42:22.683 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.680+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b22b70c0:::benchmark_data_smithi165_34272_object2570:head, will try copies on 2,3 2024-09-17T16:42:22.712 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.709+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2167a3ad:::benchmark_data_smithi165_34272_object1792:head, will try copies on 0,4 2024-09-17T16:42:22.717 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.713+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5197e199:::benchmark_data_smithi165_34272_object222:head, will try copies on 3,4 2024-09-17T16:42:22.731 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.727+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99e863a8:::benchmark_data_smithi165_34272_object4379:head, will try copies on 0,4 2024-09-17T16:42:22.733 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.729+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b271d3f3:::benchmark_data_smithi165_34272_object3003:head, will try copies on 2,3 2024-09-17T16:42:22.759 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.756+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:688bff9e:::benchmark_data_smithi165_34272_object2148:head, will try copies on 3,4 2024-09-17T16:42:22.769 INFO:tasks.radosbench.radosbench.0.smithi165.stdout: 359 15 4856922 4856907 845.485 844.75 0.000551061 0.00117201 2024-09-17T16:42:22.789 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.786+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:969c940a:::benchmark_data_smithi165_34272_object2549:head, will try copies on 0,4 2024-09-17T16:42:22.791 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.788+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53b4fe54:::benchmark_data_smithi165_34272_object3267:head, will try copies on 3,4 2024-09-17T16:42:22.808 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.805+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6398e0a6:::benchmark_data_smithi165_34272_object668:head, will try copies on 3,4 2024-09-17T16:42:22.810 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.807+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b20104ab:::benchmark_data_smithi165_34272_object374:head, will try copies on 2,3 2024-09-17T16:42:22.812 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.809+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:957b57cb:::benchmark_data_smithi165_34272_object985:head, will try copies on 0,4 2024-09-17T16:42:22.835 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.832+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:53284323:::benchmark_data_smithi165_34272_object2533:head, will try copies on 3,4 2024-09-17T16:42:22.840 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.837+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2b9cea1e:::benchmark_data_smithi165_34272_object1997:head, will try copies on 0,4 2024-09-17T16:42:22.848 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.845+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcb934e9:::benchmark_data_smithi165_34272_object3431:head, will try copies on 2,3 2024-09-17T16:42:22.862 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.858+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63ec02e8:::benchmark_data_smithi165_34272_object1964:head, will try copies on 3,4 2024-09-17T16:42:22.879 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.875+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:25f3171f:::benchmark_data_smithi165_34272_object138:head, will try copies on 0,4 2024-09-17T16:42:22.893 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.889+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:42:22.896 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.893+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bcfb3fb7:::benchmark_data_smithi165_34272_object2938:head, will try copies on 2,3 2024-09-17T16:42:22.898 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.895+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61e56d64:::benchmark_data_smithi165_34272_object2679:head, will try copies on 3,4 2024-09-17T16:42:22.900 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.897+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:42:22.923 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.920+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d7dd7a3:::benchmark_data_smithi165_34272_object3691:head, will try copies on 0,4 2024-09-17T16:42:22.925 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.922+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:54cd13bb:::benchmark_data_smithi165_34272_object1336:head, will try copies on 3,4 2024-09-17T16:42:22.937 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.934+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6a1509d4:::benchmark_data_smithi165_34272_object4215:head, will try copies on 3,4 2024-09-17T16:42:22.941 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.938+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b89de8d6:::benchmark_data_smithi165_34272_object1070:head, will try copies on 2,3 2024-09-17T16:42:22.978 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.975+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:97971d7e:::benchmark_data_smithi165_34272_object3202:head, will try copies on 0,4 2024-09-17T16:42:22.994 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.990+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:65b59863:::benchmark_data_smithi165_34272_object1545:head, will try copies on 3,4 2024-09-17T16:42:22.995 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:22.992+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d6c9b31:::benchmark_data_smithi165_34272_object1870:head, will try copies on 3,4 2024-09-17T16:42:23.011 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.008+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2cb9c96b:::benchmark_data_smithi165_34272_object3471:head, will try copies on 0,4 2024-09-17T16:42:23.012 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.008+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9647061d:::benchmark_data_smithi165_34272_object3280:head, will try copies on 0,4 2024-09-17T16:42:23.045 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.042+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d918523:::benchmark_data_smithi165_34272_object1207:head, will try copies on 3,4 2024-09-17T16:42:23.056 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.053+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:27fce5d7:::benchmark_data_smithi165_34272_object1998:head, will try copies on 0,4 2024-09-17T16:42:23.060 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.057+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf45a1ab:::benchmark_data_smithi165_34272_object2238:head, will try copies on 2,3 2024-09-17T16:42:23.073 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.070+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:96f7b4f7:::benchmark_data_smithi165_34272_object2614:head, will try copies on 0,4 2024-09-17T16:42:23.074 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.071+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:52694c21:::benchmark_data_smithi165_34272_object2419:head, will try copies on 3,4 2024-09-17T16:42:23.079 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.076+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:ba7563c0:::benchmark_data_smithi165_34272_object2750:head, will try copies on 2,3 2024-09-17T16:42:23.101 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.097+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b5948b8e:::benchmark_data_smithi165_34272_object3974:head, will try copies on 2,3 2024-09-17T16:42:23.106 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.103+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2fdb8ae3:::benchmark_data_smithi165_34272_object4552:head, will try copies on 0,4 2024-09-17T16:42:23.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.125+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6e4f1134:::benchmark_data_smithi165_34272_object2656:head, will try copies on 3,4 2024-09-17T16:42:23.128 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.125+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:26705854:::benchmark_data_smithi165_34272_object2710:head, will try copies on 0,4 2024-09-17T16:42:23.130 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.127+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b720531b:::benchmark_data_smithi165_34272_object2700:head, will try copies on 2,3 2024-09-17T16:42:23.144 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.140+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:623daebc:::benchmark_data_smithi165_34272_object1937:head, will try copies on 3,4 2024-09-17T16:42:23.153 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.150+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:209b283d:::benchmark_data_smithi165_34272_object986:head, will try copies on 0,4 2024-09-17T16:42:23.168 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.165+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5404dd36:::benchmark_data_smithi165_34272_object1676:head, will try copies on 3,4 2024-09-17T16:42:23.174 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.171+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69981732:::benchmark_data_smithi165_34272_object3377:head, will try copies on 3,4 2024-09-17T16:42:23.175 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.172+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:be75edbc:::benchmark_data_smithi165_34272_object3187:head, will try copies on 2,3 2024-09-17T16:42:23.207 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.204+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63c0b627:::benchmark_data_smithi165_34272_object1102:head, will try copies on 3,4 2024-09-17T16:42:23.275 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.271+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d51b6ae:::benchmark_data_smithi165_34272_object2747:head, will try copies on 3,4 2024-09-17T16:42:23.285 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.281+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:baec562a:::benchmark_data_smithi165_34272_object170:head, will try copies on 2,3 2024-09-17T16:42:23.294 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.290+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5e40cf3a:::benchmark_data_smithi165_34272_object757:head, will try copies on 3,4 2024-09-17T16:42:23.321 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.318+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6dde2b4c:::benchmark_data_smithi165_34272_object4239:head, will try copies on 3,4 2024-09-17T16:42:23.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.327+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:284d6f50:::benchmark_data_smithi165_34272_object998:head, will try copies on 0,4 2024-09-17T16:42:23.331 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.327+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:42:23.337 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.333+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9f83a127:::benchmark_data_smithi165_34272_object3318:head, will try copies on 0,4 2024-09-17T16:42:23.362 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.359+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bb12c09e:::benchmark_data_smithi165_34272_object2353:head, will try copies on 2,3 2024-09-17T16:42:23.369 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.366+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66b21bfe:::benchmark_data_smithi165_34272_object3290:head, will try copies on 3,4 2024-09-17T16:42:23.378 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.375+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9eb59b45:::benchmark_data_smithi165_34272_object2573:head, will try copies on 0,4 2024-09-17T16:42:23.389 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.386+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51395573:::benchmark_data_smithi165_34272_object2992:head, will try copies on 3,4 2024-09-17T16:42:23.394 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.391+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b8ba75e7:::benchmark_data_smithi165_34272_object4501:head, will try copies on 2,3 2024-09-17T16:42:23.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.410+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:63472927:::benchmark_data_smithi165_34272_object1035:head, will try copies on 3,4 2024-09-17T16:42:23.414 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.411+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:51a3c807:::benchmark_data_smithi165_34272_object3045:head, will try copies on 3,4 2024-09-17T16:42:23.432 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.429+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b13b0cb1:::benchmark_data_smithi165_34272_object2728:head, will try copies on 2,3 2024-09-17T16:42:23.447 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.444+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9986e2eb:::benchmark_data_smithi165_34272_object166:head, will try copies on 0,4 2024-09-17T16:42:23.459 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.455+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2aca2b0a:::benchmark_data_smithi165_34272_object2091:head, will try copies on 0,4 2024-09-17T16:42:23.462 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.459+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6996222d:::benchmark_data_smithi165_34272_object3443:head, will try copies on 3,4 2024-09-17T16:42:23.463 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.459+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:526b5312:::benchmark_data_smithi165_34272_object4327:head, will try copies on 3,4 2024-09-17T16:42:23.475 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.472+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:942ee625:::benchmark_data_smithi165_34272_object2443:head, will try copies on 0,4 2024-09-17T16:42:23.487 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.484+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:66f6d7ed:::benchmark_data_smithi165_34272_object2818:head, will try copies on 3,4 2024-09-17T16:42:23.499 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.495+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:591f83b2:::benchmark_data_smithi165_34272_object535:head, will try copies on 3,4 2024-09-17T16:42:23.526 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.522+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b02e80f9:::benchmark_data_smithi165_34272_object940:head, will try copies on 2,3 2024-09-17T16:42:23.537 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.531+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2917ba58:::benchmark_data_smithi165_34272_object924:head, will try copies on 0,4 2024-09-17T16:42:23.542 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.539+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6451d693:::benchmark_data_smithi165_34272_object3926:head, will try copies on 3,4 2024-09-17T16:42:23.543 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.540+0000 7f25a2a5d640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:b1c44326:::benchmark_data_smithi165_34272_object2072:head, will try copies on 2,3 2024-09-17T16:42:23.557 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.554+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:93b44e7b:::benchmark_data_smithi165_34272_object4279:head, will try copies on 0,4 2024-09-17T16:42:23.562 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.559+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:242a9e2d:::benchmark_data_smithi165_34272_object1752:head, will try copies on 0,4 2024-09-17T16:42:23.579 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.576+0000 7f25a4260640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:58f5bc66:::benchmark_data_smithi165_34272_object4160:head, will try copies on 3,4 2024-09-17T16:42:23.588 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.585+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a45441:::benchmark_data_smithi165_34272_object1203:head, will try copies on 3,4 2024-09-17T16:42:23.603 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.600+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:201e4171:::benchmark_data_smithi165_34272_object2315:head, will try copies on 0,4 2024-09-17T16:42:23.612 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.609+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:9d53ba41:::benchmark_data_smithi165_34272_object161:head, will try copies on 0,4 2024-09-17T16:42:23.632 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.629+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5c64c60a:::benchmark_data_smithi165_34272_object2460:head, will try copies on 3,4 2024-09-17T16:42:23.642 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.639+0000 7f25a325e640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:28a0c0b5:::benchmark_data_smithi165_34272_object1039:head, will try copies on 0,4 2024-09-17T16:42:23.663 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.660+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:69a4cd27:::benchmark_data_smithi165_34272_object3835:head, will try copies on 3,4 2024-09-17T16:42:23.679 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.675+0000 7f259ea55640 -1 log_channel(cluster) log [ERR] : 2.d missing primary copy of 2:bf3454f2:::benchmark_data_smithi165_34272_object3102:head, will try copies on 2,3 2024-09-17T16:42:23.690 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.686+0000 7f259f256640 -1 log_channel(cluster) log [ERR] : 2.4 missing primary copy of 2:2136e5dc:::benchmark_data_smithi165_34272_object3017:head, will try copies on 0,4 2024-09-17T16:42:23.697 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.694+0000 7f259e254640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:6285831e:::benchmark_data_smithi165_34272_object3570:head, will try copies on 3,4 2024-09-17T16:42:23.700 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.696+0000 7f25a4a61640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:99fb47bb:::benchmark_data_smithi165_34272_object660:head, will try copies on 0,4 2024-09-17T16:42:23.719 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.716+0000 7f25a0258640 -1 log_channel(cluster) log [ERR] : 2.a missing primary copy of 2:5d75708b:::benchmark_data_smithi165_34272_object2274:head, will try copies on 3,4 2024-09-17T16:42:23.726 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.723+0000 7f25a225c640 -1 log_channel(cluster) log [ERR] : 2.6 missing primary copy of 2:61aba360:::benchmark_data_smithi165_34272_object4482:head, will try copies on 3,4 2024-09-17T16:42:23.732 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-17T16:42:23.729+0000 7f25a0a59640 -1 log_channel(cluster) log [ERR] : 2.9 missing primary copy of 2:92d6bb06:::benchmark_data_smithi165_34272_object284:head, will try copies on 0,4 2024-09-17T16:42:23.770 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total time run: 360.006 2024-09-17T16:42:23.770 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Total reads made: 4869997 2024-09-17T16:42:23.770 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Read size: 65536 2024-09-17T16:42:23.770 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Object size: 1048576 2024-09-17T16:42:23.770 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Bandwidth (MB/sec): 845.471 2024-09-17T16:42:23.770 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average IOPS: 13527 2024-09-17T16:42:23.770 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Stddev IOPS: 453.401 2024-09-17T16:42:23.771 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max IOPS: 14376 2024-09-17T16:42:23.771 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min IOPS: 10402 2024-09-17T16:42:23.771 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Average Latency(s): 0.00117202 2024-09-17T16:42:23.771 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Max latency(s): 0.222415 2024-09-17T16:42:23.771 INFO:tasks.radosbench.radosbench.0.smithi165.stdout:Min latency(s): 0.000227768 2024-09-17T16:42:29.793 INFO:teuthology.task.full_sequential:In full_sequential, running task exec... 2024-09-17T16:42:29.794 INFO:teuthology.task.exec:Executing custom commands... 2024-09-17T16:42:29.794 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:42:29.794 DEBUG:teuthology.orchestra.run.smithi165:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph tell osd.1 injectargs -- --bluestore_debug_random_read_err=0.0' 2024-09-17T16:42:30.128 INFO:teuthology.orchestra.run.smithi165.stdout:{} 2024-09-17T16:42:30.128 INFO:teuthology.orchestra.run.smithi165.stderr:bluestore_debug_random_read_err = '' (not observed, change may require restart) 2024-09-17T16:42:30.141 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T16:42:30.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T16:42:30.150 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-17T16:42:34.558588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4787732523,"num_objects":4569,"num_object_clones":0,"num_object_copies":13705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4569,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73058,"num_write_kb":4675523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73059,"ondisk_log_size":73059,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1496360,"kb_used_data":877640,"kb_used_omap":9,"kb_used_meta":618614,"kb_avail":564734680,"statfs":{"total":579820584960,"available":578288312320,"internally_reserved":0,"allocated":898703360,"data_stored":14363511512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":9568,"internal_metadata":633461408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72510,"num_read_kb":4640640,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":522190848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":498},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003414"},"pg_stats":[{"pgid":"2.f","version":"19'4416","reported_seq":300365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733259+0000","last_change":"2024-09-17T16:35:23.135379+0000","last_active":"2024-09-17T16:42:23.733259+0000","last_peered":"2024-09-17T16:42:23.733259+0000","last_clean":"2024-09-17T16:42:23.733259+0000","last_became_active":"2024-09-17T16:35:23.135050+0000","last_became_peered":"2024-09-17T16:35:23.135050+0000","last_unstale":"2024-09-17T16:42:23.733259+0000","last_undegraded":"2024-09-17T16:42:23.733259+0000","last_fullsized":"2024-09-17T16:42:23.733259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4416,"log_dups_size":0,"ondisk_log_size":4416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:07:06.939078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":276,"num_whiteouts":0,"num_read":295931,"num_read_kb":18939584,"num_write":4416,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"19'4512","reported_seq":305618,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.732760+0000","last_change":"2024-09-17T16:35:23.135317+0000","last_active":"2024-09-17T16:42:23.732760+0000","last_peered":"2024-09-17T16:42:23.732760+0000","last_clean":"2024-09-17T16:42:23.732760+0000","last_became_active":"2024-09-17T16:35:23.134919+0000","last_became_peered":"2024-09-17T16:35:23.134919+0000","last_unstale":"2024-09-17T16:42:23.732760+0000","last_undegraded":"2024-09-17T16:42:23.732760+0000","last_fullsized":"2024-09-17T16:42:23.732760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:44.510767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":301088,"num_read_kb":19269632,"num_write":4512,"num_write_kb":288768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'4513","reported_seq":346591,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733678+0000","last_change":"2024-09-17T16:42:23.689863+0000","last_active":"2024-09-17T16:42:23.733678+0000","last_peered":"2024-09-17T16:42:23.733678+0000","last_clean":"2024-09-17T16:42:23.733678+0000","last_became_active":"2024-09-17T16:35:23.134864+0000","last_became_peered":"2024-09-17T16:35:23.134864+0000","last_unstale":"2024-09-17T16:42:23.733678+0000","last_undegraded":"2024-09-17T16:42:23.733678+0000","last_fullsized":"2024-09-17T16:42:23.733678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:56.394362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":300158,"num_read_kb":19210049,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6029,"num_bytes_recovered":6321864704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6029},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"19'4672","reported_seq":316214,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.731933+0000","last_change":"2024-09-17T16:35:23.135621+0000","last_active":"2024-09-17T16:42:23.731933+0000","last_peered":"2024-09-17T16:42:23.731933+0000","last_clean":"2024-09-17T16:42:23.731933+0000","last_became_active":"2024-09-17T16:35:23.135226+0000","last_became_peered":"2024-09-17T16:35:23.135226+0000","last_unstale":"2024-09-17T16:42:23.731933+0000","last_undegraded":"2024-09-17T16:42:23.731933+0000","last_fullsized":"2024-09-17T16:42:23.731933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4672,"log_dups_size":0,"ondisk_log_size":4672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:18.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":292,"num_whiteouts":0,"num_read":311524,"num_read_kb":19937536,"num_write":4672,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"19'4144","reported_seq":280756,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734487+0000","last_change":"2024-09-17T16:35:23.137639+0000","last_active":"2024-09-17T16:42:23.734487+0000","last_peered":"2024-09-17T16:42:23.734487+0000","last_clean":"2024-09-17T16:42:23.734487+0000","last_became_active":"2024-09-17T16:35:23.137263+0000","last_became_peered":"2024-09-17T16:35:23.137263+0000","last_unstale":"2024-09-17T16:42:23.734487+0000","last_undegraded":"2024-09-17T16:42:23.734487+0000","last_fullsized":"2024-09-17T16:42:23.734487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:15.149439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":276594,"num_read_kb":17702016,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"19'4976","reported_seq":381993,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735488+0000","last_change":"2024-09-17T16:42:23.734021+0000","last_active":"2024-09-17T16:42:23.735488+0000","last_peered":"2024-09-17T16:42:23.735488+0000","last_clean":"2024-09-17T16:42:23.735488+0000","last_became_active":"2024-09-17T16:35:23.138383+0000","last_became_peered":"2024-09-17T16:35:23.138383+0000","last_unstale":"2024-09-17T16:42:23.735488+0000","last_undegraded":"2024-09-17T16:42:23.735488+0000","last_fullsized":"2024-09-17T16:42:23.735488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4976,"log_dups_size":0,"ondisk_log_size":4976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:07:58.067464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326107136,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":332554,"num_read_kb":21283456,"num_write":4976,"num_write_kb":318464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6410,"num_bytes_recovered":6721372160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6410},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"19'4864","reported_seq":371921,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.742563+0000","last_change":"2024-09-17T16:42:23.743006+0000","last_active":"2024-09-17T16:42:23.742563+0000","last_peered":"2024-09-17T16:42:23.742563+0000","last_clean":"2024-09-17T16:42:23.742563+0000","last_became_active":"2024-09-17T16:35:23.138087+0000","last_became_peered":"2024-09-17T16:35:23.138087+0000","last_unstale":"2024-09-17T16:42:23.742563+0000","last_undegraded":"2024-09-17T16:42:23.742563+0000","last_fullsized":"2024-09-17T16:42:23.742563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:59:19.420126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":323970,"num_read_kb":20734080,"num_write":4864,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6204,"num_bytes_recovered":6505365504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6204},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"19'4735","reported_seq":319463,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735174+0000","last_change":"2024-09-17T16:35:23.135669+0000","last_active":"2024-09-17T16:42:23.735174+0000","last_peered":"2024-09-17T16:42:23.735174+0000","last_clean":"2024-09-17T16:42:23.735174+0000","last_became_active":"2024-09-17T16:35:23.135186+0000","last_became_peered":"2024-09-17T16:35:23.135186+0000","last_unstale":"2024-09-17T16:42:23.735174+0000","last_undegraded":"2024-09-17T16:42:23.735174+0000","last_fullsized":"2024-09-17T16:42:23.735174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:03:24.729635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310312960,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":296,"num_whiteouts":0,"num_read":314710,"num_read_kb":20141440,"num_write":4735,"num_write_kb":303040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:17.569139+0000","last_change":"2024-09-17T16:35:16.784739+0000","last_active":"2024-09-17T16:39:17.569139+0000","last_peered":"2024-09-17T16:39:17.569139+0000","last_clean":"2024-09-17T16:39:17.569139+0000","last_became_active":"2024-09-17T16:35:14.065657+0000","last_became_peered":"2024-09-17T16:35:14.065657+0000","last_unstale":"2024-09-17T16:39:17.569139+0000","last_undegraded":"2024-09-17T16:39:17.569139+0000","last_fullsized":"2024-09-17T16:39:17.569139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:21.720866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000412882,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'4448","reported_seq":301075,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.736160+0000","last_change":"2024-09-17T16:35:23.132819+0000","last_active":"2024-09-17T16:42:23.736160+0000","last_peered":"2024-09-17T16:42:23.736160+0000","last_clean":"2024-09-17T16:42:23.736160+0000","last_became_active":"2024-09-17T16:35:23.132603+0000","last_became_peered":"2024-09-17T16:35:23.132603+0000","last_unstale":"2024-09-17T16:42:23.736160+0000","last_undegraded":"2024-09-17T16:42:23.736160+0000","last_fullsized":"2024-09-17T16:42:23.736160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:01:22.889192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":296609,"num_read_kb":18982976,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.516457+0000","last_change":"2024-09-17T16:35:15.500097+0000","last_active":"2024-09-17T16:39:27.516457+0000","last_peered":"2024-09-17T16:39:27.516457+0000","last_clean":"2024-09-17T16:39:27.516457+0000","last_became_active":"2024-09-17T16:35:14.065746+0000","last_became_peered":"2024-09-17T16:35:14.065746+0000","last_unstale":"2024-09-17T16:39:27.516457+0000","last_undegraded":"2024-09-17T16:39:27.516457+0000","last_fullsized":"2024-09-17T16:39:27.516457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:46:37.495177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038337499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'4608","reported_seq":311295,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734824+0000","last_change":"2024-09-17T16:35:23.134619+0000","last_active":"2024-09-17T16:42:23.734824+0000","last_peered":"2024-09-17T16:42:23.734824+0000","last_clean":"2024-09-17T16:42:23.734824+0000","last_became_active":"2024-09-17T16:35:23.134260+0000","last_became_peered":"2024-09-17T16:35:23.134260+0000","last_unstale":"2024-09-17T16:42:23.734824+0000","last_undegraded":"2024-09-17T16:42:23.734824+0000","last_fullsized":"2024-09-17T16:42:23.734824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:04:54.619111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":306669,"num_read_kb":19626816,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521741+0000","last_change":"2024-09-17T16:35:15.509160+0000","last_active":"2024-09-17T16:39:27.521741+0000","last_peered":"2024-09-17T16:39:27.521741+0000","last_clean":"2024-09-17T16:39:27.521741+0000","last_became_active":"2024-09-17T16:35:14.065650+0000","last_became_peered":"2024-09-17T16:35:14.065650+0000","last_unstale":"2024-09-17T16:39:27.521741+0000","last_undegraded":"2024-09-17T16:39:27.521741+0000","last_fullsized":"2024-09-17T16:39:27.521741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:16.659322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000933667,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"19'5024","reported_seq":339260,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733158+0000","last_change":"2024-09-17T16:35:23.133615+0000","last_active":"2024-09-17T16:42:23.733158+0000","last_peered":"2024-09-17T16:42:23.733158+0000","last_clean":"2024-09-17T16:42:23.733158+0000","last_became_active":"2024-09-17T16:35:23.133244+0000","last_became_peered":"2024-09-17T16:35:23.133244+0000","last_unstale":"2024-09-17T16:42:23.733158+0000","last_undegraded":"2024-09-17T16:42:23.733158+0000","last_fullsized":"2024-09-17T16:42:23.733158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":5024,"log_dups_size":0,"ondisk_log_size":5024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:56.396416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329252864,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":334218,"num_read_kb":21389952,"num_write":5024,"num_write_kb":321536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":32,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621790+0000","last_change":"2024-09-17T16:35:16.155753+0000","last_active":"2024-09-17T16:39:27.621790+0000","last_peered":"2024-09-17T16:39:27.621790+0000","last_clean":"2024-09-17T16:39:27.621790+0000","last_became_active":"2024-09-17T16:35:13.497657+0000","last_became_peered":"2024-09-17T16:35:13.497657+0000","last_unstale":"2024-09-17T16:39:27.621790+0000","last_undegraded":"2024-09-17T16:39:27.621790+0000","last_fullsized":"2024-09-17T16:39:27.621790+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:09.210991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034153500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"19'4688","reported_seq":316270,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734735+0000","last_change":"2024-09-17T16:35:23.134860+0000","last_active":"2024-09-17T16:42:23.734735+0000","last_peered":"2024-09-17T16:42:23.734735+0000","last_clean":"2024-09-17T16:42:23.734735+0000","last_became_active":"2024-09-17T16:35:23.134320+0000","last_became_peered":"2024-09-17T16:35:23.134320+0000","last_unstale":"2024-09-17T16:42:23.734735+0000","last_undegraded":"2024-09-17T16:42:23.734735+0000","last_fullsized":"2024-09-17T16:42:23.734735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:02.294929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307232768,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":293,"num_whiteouts":0,"num_read":311564,"num_read_kb":19940096,"num_write":4688,"num_write_kb":300032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'4304","reported_seq":291594,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734728+0000","last_change":"2024-09-17T16:35:23.137829+0000","last_active":"2024-09-17T16:42:23.734728+0000","last_peered":"2024-09-17T16:42:23.734728+0000","last_clean":"2024-09-17T16:42:23.734728+0000","last_became_active":"2024-09-17T16:35:23.137488+0000","last_became_peered":"2024-09-17T16:35:23.137488+0000","last_unstale":"2024-09-17T16:42:23.734728+0000","last_undegraded":"2024-09-17T16:42:23.734728+0000","last_fullsized":"2024-09-17T16:42:23.734728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:55:39.730046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282066944,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":287272,"num_read_kb":18385408,"num_write":4304,"num_write_kb":275456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621812+0000","last_change":"2024-09-17T16:35:16.155752+0000","last_active":"2024-09-17T16:39:27.621812+0000","last_peered":"2024-09-17T16:39:27.621812+0000","last_clean":"2024-09-17T16:39:27.621812+0000","last_became_active":"2024-09-17T16:35:13.496006+0000","last_became_peered":"2024-09-17T16:35:13.496006+0000","last_unstale":"2024-09-17T16:39:27.621812+0000","last_undegraded":"2024-09-17T16:39:27.621812+0000","last_fullsized":"2024-09-17T16:39:27.621812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:35.483232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000358735,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'4912","reported_seq":376619,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.737701+0000","last_change":"2024-09-17T16:42:23.737842+0000","last_active":"2024-09-17T16:42:23.737701+0000","last_peered":"2024-09-17T16:42:23.737701+0000","last_clean":"2024-09-17T16:42:23.737701+0000","last_became_active":"2024-09-17T16:35:23.138201+0000","last_became_peered":"2024-09-17T16:35:23.138201+0000","last_unstale":"2024-09-17T16:42:23.737701+0000","last_undegraded":"2024-09-17T16:42:23.737701+0000","last_fullsized":"2024-09-17T16:42:23.737701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4912,"log_dups_size":0,"ondisk_log_size":4912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:16:58.832234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":321912832,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":307,"num_whiteouts":0,"num_read":327425,"num_read_kb":20955200,"num_write":4912,"num_write_kb":314368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6380,"num_bytes_recovered":6689914880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6380},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521775+0000","last_change":"2024-09-17T16:35:15.508716+0000","last_active":"2024-09-17T16:39:27.521775+0000","last_peered":"2024-09-17T16:39:27.521775+0000","last_clean":"2024-09-17T16:39:27.521775+0000","last_became_active":"2024-09-17T16:35:14.134117+0000","last_became_peered":"2024-09-17T16:35:14.134117+0000","last_unstale":"2024-09-17T16:39:27.521775+0000","last_undegraded":"2024-09-17T16:39:27.521775+0000","last_fullsized":"2024-09-17T16:39:27.521775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:05.162593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044059299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"19'4224","reported_seq":285679,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.730694+0000","last_change":"2024-09-17T16:35:23.137985+0000","last_active":"2024-09-17T16:42:23.730694+0000","last_peered":"2024-09-17T16:42:23.730694+0000","last_clean":"2024-09-17T16:42:23.730694+0000","last_became_active":"2024-09-17T16:35:23.137624+0000","last_became_peered":"2024-09-17T16:35:23.137624+0000","last_unstale":"2024-09-17T16:42:23.730694+0000","last_undegraded":"2024-09-17T16:42:23.730694+0000","last_fullsized":"2024-09-17T16:42:23.730694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:24:25.523270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":281437,"num_read_kb":18011968,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.573596+0000","last_change":"2024-09-17T16:35:16.784770+0000","last_active":"2024-09-17T16:39:37.573596+0000","last_peered":"2024-09-17T16:39:37.573596+0000","last_clean":"2024-09-17T16:39:37.573596+0000","last_became_active":"2024-09-17T16:35:14.065678+0000","last_became_peered":"2024-09-17T16:35:14.065678+0000","last_unstale":"2024-09-17T16:39:37.573596+0000","last_undegraded":"2024-09-17T16:39:37.573596+0000","last_fullsized":"2024-09-17T16:39:37.573596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:04:47.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041479400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.517802+0000","last_change":"2024-09-17T16:35:15.500105+0000","last_active":"2024-09-17T16:39:37.517802+0000","last_peered":"2024-09-17T16:39:37.517802+0000","last_clean":"2024-09-17T16:39:37.517802+0000","last_became_active":"2024-09-17T16:35:14.134094+0000","last_became_peered":"2024-09-17T16:35:14.134094+0000","last_unstale":"2024-09-17T16:39:37.517802+0000","last_undegraded":"2024-09-17T16:39:37.517802+0000","last_fullsized":"2024-09-17T16:39:37.517802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:52.933293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037500100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"19'4016","reported_seq":311085,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734719+0000","last_change":"2024-09-17T16:42:23.704022+0000","last_active":"2024-09-17T16:42:23.734719+0000","last_peered":"2024-09-17T16:42:23.734719+0000","last_clean":"2024-09-17T16:42:23.734719+0000","last_became_active":"2024-09-17T16:35:23.137988+0000","last_became_peered":"2024-09-17T16:35:23.137988+0000","last_unstale":"2024-09-17T16:42:23.734719+0000","last_undegraded":"2024-09-17T16:42:23.734719+0000","last_fullsized":"2024-09-17T16:42:23.734719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:11:40.045121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":268275,"num_read_kb":17169600,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5571,"num_bytes_recovered":5841616896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5571},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4787732504,"num_objects":4567,"num_object_clones":0,"num_object_copies":13701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4567,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73056,"num_write_kb":4675521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":897712128,"data_stored":14363197512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":0,"internal_metadata":0},"log_size":73056,"ondisk_log_size":73056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640346,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138796,"kb_used_data":89564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94233044,"statfs":{"total":96636764160,"available":96494637056,"internally_reserved":0,"allocated":91713536,"data_stored":1464847463,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640347,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228852,"kb_used_data":143588,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94142988,"statfs":{"total":96636764160,"available":96402419712,"internally_reserved":0,"allocated":147034112,"data_stored":2349911162,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640347,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254320,"kb_used_data":182880,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94117520,"statfs":{"total":96636764160,"available":96376340480,"internally_reserved":0,"allocated":187269120,"data_stored":2993671295,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640347,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155124,"kb_used_data":110052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94216716,"statfs":{"total":96636764160,"available":96477917184,"internally_reserved":0,"allocated":112693248,"data_stored":1800457343,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460468,"kb_used_data":168356,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93911372,"statfs":{"total":96636764160,"available":96165244928,"internally_reserved":0,"allocated":172396544,"data_stored":2755710079,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640347,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258800,"kb_used_data":183200,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94113040,"statfs":{"total":96636764160,"available":96371752960,"internally_reserved":0,"allocated":187596800,"data_stored":2998914170,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187428864,"data_stored":2998861824,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172232704,"data_stored":2755657752,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112529408,"data_stored":1800405016,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187105280,"data_stored":2993618968,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":146866176,"data_stored":2349858816,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":91549696,"data_stored":1464795136,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:35.188 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:35.469 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:42:35.470 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-17T16:42:35.482 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-17T16:42:34.558588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4787732523,"num_objects":4569,"num_object_clones":0,"num_object_copies":13705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4569,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73058,"num_write_kb":4675523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73059,"ondisk_log_size":73059,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1496360,"kb_used_data":877640,"kb_used_omap":9,"kb_used_meta":618614,"kb_avail":564734680,"statfs":{"total":579820584960,"available":578288312320,"internally_reserved":0,"allocated":898703360,"data_stored":14363511512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":9568,"internal_metadata":633461408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72510,"num_read_kb":4640640,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":522190848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":498},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003414"},"pg_stats":[{"pgid":"2.f","version":"19'4416","reported_seq":300365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733259+0000","last_change":"2024-09-17T16:35:23.135379+0000","last_active":"2024-09-17T16:42:23.733259+0000","last_peered":"2024-09-17T16:42:23.733259+0000","last_clean":"2024-09-17T16:42:23.733259+0000","last_became_active":"2024-09-17T16:35:23.135050+0000","last_became_peered":"2024-09-17T16:35:23.135050+0000","last_unstale":"2024-09-17T16:42:23.733259+0000","last_undegraded":"2024-09-17T16:42:23.733259+0000","last_fullsized":"2024-09-17T16:42:23.733259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4416,"log_dups_size":0,"ondisk_log_size":4416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:07:06.939078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":276,"num_whiteouts":0,"num_read":295931,"num_read_kb":18939584,"num_write":4416,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"19'4512","reported_seq":305618,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.732760+0000","last_change":"2024-09-17T16:35:23.135317+0000","last_active":"2024-09-17T16:42:23.732760+0000","last_peered":"2024-09-17T16:42:23.732760+0000","last_clean":"2024-09-17T16:42:23.732760+0000","last_became_active":"2024-09-17T16:35:23.134919+0000","last_became_peered":"2024-09-17T16:35:23.134919+0000","last_unstale":"2024-09-17T16:42:23.732760+0000","last_undegraded":"2024-09-17T16:42:23.732760+0000","last_fullsized":"2024-09-17T16:42:23.732760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:44.510767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":301088,"num_read_kb":19269632,"num_write":4512,"num_write_kb":288768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'4513","reported_seq":346591,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733678+0000","last_change":"2024-09-17T16:42:23.689863+0000","last_active":"2024-09-17T16:42:23.733678+0000","last_peered":"2024-09-17T16:42:23.733678+0000","last_clean":"2024-09-17T16:42:23.733678+0000","last_became_active":"2024-09-17T16:35:23.134864+0000","last_became_peered":"2024-09-17T16:35:23.134864+0000","last_unstale":"2024-09-17T16:42:23.733678+0000","last_undegraded":"2024-09-17T16:42:23.733678+0000","last_fullsized":"2024-09-17T16:42:23.733678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:56.394362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":300158,"num_read_kb":19210049,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6029,"num_bytes_recovered":6321864704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6029},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"19'4672","reported_seq":316214,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.731933+0000","last_change":"2024-09-17T16:35:23.135621+0000","last_active":"2024-09-17T16:42:23.731933+0000","last_peered":"2024-09-17T16:42:23.731933+0000","last_clean":"2024-09-17T16:42:23.731933+0000","last_became_active":"2024-09-17T16:35:23.135226+0000","last_became_peered":"2024-09-17T16:35:23.135226+0000","last_unstale":"2024-09-17T16:42:23.731933+0000","last_undegraded":"2024-09-17T16:42:23.731933+0000","last_fullsized":"2024-09-17T16:42:23.731933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4672,"log_dups_size":0,"ondisk_log_size":4672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:18.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":292,"num_whiteouts":0,"num_read":311524,"num_read_kb":19937536,"num_write":4672,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"19'4144","reported_seq":280756,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734487+0000","last_change":"2024-09-17T16:35:23.137639+0000","last_active":"2024-09-17T16:42:23.734487+0000","last_peered":"2024-09-17T16:42:23.734487+0000","last_clean":"2024-09-17T16:42:23.734487+0000","last_became_active":"2024-09-17T16:35:23.137263+0000","last_became_peered":"2024-09-17T16:35:23.137263+0000","last_unstale":"2024-09-17T16:42:23.734487+0000","last_undegraded":"2024-09-17T16:42:23.734487+0000","last_fullsized":"2024-09-17T16:42:23.734487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:15.149439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":276594,"num_read_kb":17702016,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"19'4976","reported_seq":381993,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735488+0000","last_change":"2024-09-17T16:42:23.734021+0000","last_active":"2024-09-17T16:42:23.735488+0000","last_peered":"2024-09-17T16:42:23.735488+0000","last_clean":"2024-09-17T16:42:23.735488+0000","last_became_active":"2024-09-17T16:35:23.138383+0000","last_became_peered":"2024-09-17T16:35:23.138383+0000","last_unstale":"2024-09-17T16:42:23.735488+0000","last_undegraded":"2024-09-17T16:42:23.735488+0000","last_fullsized":"2024-09-17T16:42:23.735488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4976,"log_dups_size":0,"ondisk_log_size":4976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:07:58.067464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326107136,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":332554,"num_read_kb":21283456,"num_write":4976,"num_write_kb":318464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6410,"num_bytes_recovered":6721372160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6410},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"19'4864","reported_seq":371921,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.742563+0000","last_change":"2024-09-17T16:42:23.743006+0000","last_active":"2024-09-17T16:42:23.742563+0000","last_peered":"2024-09-17T16:42:23.742563+0000","last_clean":"2024-09-17T16:42:23.742563+0000","last_became_active":"2024-09-17T16:35:23.138087+0000","last_became_peered":"2024-09-17T16:35:23.138087+0000","last_unstale":"2024-09-17T16:42:23.742563+0000","last_undegraded":"2024-09-17T16:42:23.742563+0000","last_fullsized":"2024-09-17T16:42:23.742563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:59:19.420126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":323970,"num_read_kb":20734080,"num_write":4864,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6204,"num_bytes_recovered":6505365504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6204},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"19'4735","reported_seq":319463,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735174+0000","last_change":"2024-09-17T16:35:23.135669+0000","last_active":"2024-09-17T16:42:23.735174+0000","last_peered":"2024-09-17T16:42:23.735174+0000","last_clean":"2024-09-17T16:42:23.735174+0000","last_became_active":"2024-09-17T16:35:23.135186+0000","last_became_peered":"2024-09-17T16:35:23.135186+0000","last_unstale":"2024-09-17T16:42:23.735174+0000","last_undegraded":"2024-09-17T16:42:23.735174+0000","last_fullsized":"2024-09-17T16:42:23.735174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:03:24.729635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310312960,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":296,"num_whiteouts":0,"num_read":314710,"num_read_kb":20141440,"num_write":4735,"num_write_kb":303040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:17.569139+0000","last_change":"2024-09-17T16:35:16.784739+0000","last_active":"2024-09-17T16:39:17.569139+0000","last_peered":"2024-09-17T16:39:17.569139+0000","last_clean":"2024-09-17T16:39:17.569139+0000","last_became_active":"2024-09-17T16:35:14.065657+0000","last_became_peered":"2024-09-17T16:35:14.065657+0000","last_unstale":"2024-09-17T16:39:17.569139+0000","last_undegraded":"2024-09-17T16:39:17.569139+0000","last_fullsized":"2024-09-17T16:39:17.569139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:21.720866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000412882,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'4448","reported_seq":301075,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.736160+0000","last_change":"2024-09-17T16:35:23.132819+0000","last_active":"2024-09-17T16:42:23.736160+0000","last_peered":"2024-09-17T16:42:23.736160+0000","last_clean":"2024-09-17T16:42:23.736160+0000","last_became_active":"2024-09-17T16:35:23.132603+0000","last_became_peered":"2024-09-17T16:35:23.132603+0000","last_unstale":"2024-09-17T16:42:23.736160+0000","last_undegraded":"2024-09-17T16:42:23.736160+0000","last_fullsized":"2024-09-17T16:42:23.736160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:01:22.889192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":296609,"num_read_kb":18982976,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.516457+0000","last_change":"2024-09-17T16:35:15.500097+0000","last_active":"2024-09-17T16:39:27.516457+0000","last_peered":"2024-09-17T16:39:27.516457+0000","last_clean":"2024-09-17T16:39:27.516457+0000","last_became_active":"2024-09-17T16:35:14.065746+0000","last_became_peered":"2024-09-17T16:35:14.065746+0000","last_unstale":"2024-09-17T16:39:27.516457+0000","last_undegraded":"2024-09-17T16:39:27.516457+0000","last_fullsized":"2024-09-17T16:39:27.516457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:46:37.495177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038337499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'4608","reported_seq":311295,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734824+0000","last_change":"2024-09-17T16:35:23.134619+0000","last_active":"2024-09-17T16:42:23.734824+0000","last_peered":"2024-09-17T16:42:23.734824+0000","last_clean":"2024-09-17T16:42:23.734824+0000","last_became_active":"2024-09-17T16:35:23.134260+0000","last_became_peered":"2024-09-17T16:35:23.134260+0000","last_unstale":"2024-09-17T16:42:23.734824+0000","last_undegraded":"2024-09-17T16:42:23.734824+0000","last_fullsized":"2024-09-17T16:42:23.734824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:04:54.619111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":306669,"num_read_kb":19626816,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521741+0000","last_change":"2024-09-17T16:35:15.509160+0000","last_active":"2024-09-17T16:39:27.521741+0000","last_peered":"2024-09-17T16:39:27.521741+0000","last_clean":"2024-09-17T16:39:27.521741+0000","last_became_active":"2024-09-17T16:35:14.065650+0000","last_became_peered":"2024-09-17T16:35:14.065650+0000","last_unstale":"2024-09-17T16:39:27.521741+0000","last_undegraded":"2024-09-17T16:39:27.521741+0000","last_fullsized":"2024-09-17T16:39:27.521741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:16.659322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000933667,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"19'5024","reported_seq":339260,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733158+0000","last_change":"2024-09-17T16:35:23.133615+0000","last_active":"2024-09-17T16:42:23.733158+0000","last_peered":"2024-09-17T16:42:23.733158+0000","last_clean":"2024-09-17T16:42:23.733158+0000","last_became_active":"2024-09-17T16:35:23.133244+0000","last_became_peered":"2024-09-17T16:35:23.133244+0000","last_unstale":"2024-09-17T16:42:23.733158+0000","last_undegraded":"2024-09-17T16:42:23.733158+0000","last_fullsized":"2024-09-17T16:42:23.733158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":5024,"log_dups_size":0,"ondisk_log_size":5024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:56.396416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329252864,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":334218,"num_read_kb":21389952,"num_write":5024,"num_write_kb":321536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":32,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621790+0000","last_change":"2024-09-17T16:35:16.155753+0000","last_active":"2024-09-17T16:39:27.621790+0000","last_peered":"2024-09-17T16:39:27.621790+0000","last_clean":"2024-09-17T16:39:27.621790+0000","last_became_active":"2024-09-17T16:35:13.497657+0000","last_became_peered":"2024-09-17T16:35:13.497657+0000","last_unstale":"2024-09-17T16:39:27.621790+0000","last_undegraded":"2024-09-17T16:39:27.621790+0000","last_fullsized":"2024-09-17T16:39:27.621790+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:09.210991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034153500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"19'4688","reported_seq":316270,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734735+0000","last_change":"2024-09-17T16:35:23.134860+0000","last_active":"2024-09-17T16:42:23.734735+0000","last_peered":"2024-09-17T16:42:23.734735+0000","last_clean":"2024-09-17T16:42:23.734735+0000","last_became_active":"2024-09-17T16:35:23.134320+0000","last_became_peered":"2024-09-17T16:35:23.134320+0000","last_unstale":"2024-09-17T16:42:23.734735+0000","last_undegraded":"2024-09-17T16:42:23.734735+0000","last_fullsized":"2024-09-17T16:42:23.734735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:02.294929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307232768,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":293,"num_whiteouts":0,"num_read":311564,"num_read_kb":19940096,"num_write":4688,"num_write_kb":300032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'4304","reported_seq":291594,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734728+0000","last_change":"2024-09-17T16:35:23.137829+0000","last_active":"2024-09-17T16:42:23.734728+0000","last_peered":"2024-09-17T16:42:23.734728+0000","last_clean":"2024-09-17T16:42:23.734728+0000","last_became_active":"2024-09-17T16:35:23.137488+0000","last_became_peered":"2024-09-17T16:35:23.137488+0000","last_unstale":"2024-09-17T16:42:23.734728+0000","last_undegraded":"2024-09-17T16:42:23.734728+0000","last_fullsized":"2024-09-17T16:42:23.734728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:55:39.730046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282066944,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":287272,"num_read_kb":18385408,"num_write":4304,"num_write_kb":275456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621812+0000","last_change":"2024-09-17T16:35:16.155752+0000","last_active":"2024-09-17T16:39:27.621812+0000","last_peered":"2024-09-17T16:39:27.621812+0000","last_clean":"2024-09-17T16:39:27.621812+0000","last_became_active":"2024-09-17T16:35:13.496006+0000","last_became_peered":"2024-09-17T16:35:13.496006+0000","last_unstale":"2024-09-17T16:39:27.621812+0000","last_undegraded":"2024-09-17T16:39:27.621812+0000","last_fullsized":"2024-09-17T16:39:27.621812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:35.483232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000358735,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'4912","reported_seq":376619,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.737701+0000","last_change":"2024-09-17T16:42:23.737842+0000","last_active":"2024-09-17T16:42:23.737701+0000","last_peered":"2024-09-17T16:42:23.737701+0000","last_clean":"2024-09-17T16:42:23.737701+0000","last_became_active":"2024-09-17T16:35:23.138201+0000","last_became_peered":"2024-09-17T16:35:23.138201+0000","last_unstale":"2024-09-17T16:42:23.737701+0000","last_undegraded":"2024-09-17T16:42:23.737701+0000","last_fullsized":"2024-09-17T16:42:23.737701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4912,"log_dups_size":0,"ondisk_log_size":4912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:16:58.832234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":321912832,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":307,"num_whiteouts":0,"num_read":327425,"num_read_kb":20955200,"num_write":4912,"num_write_kb":314368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6380,"num_bytes_recovered":6689914880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6380},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521775+0000","last_change":"2024-09-17T16:35:15.508716+0000","last_active":"2024-09-17T16:39:27.521775+0000","last_peered":"2024-09-17T16:39:27.521775+0000","last_clean":"2024-09-17T16:39:27.521775+0000","last_became_active":"2024-09-17T16:35:14.134117+0000","last_became_peered":"2024-09-17T16:35:14.134117+0000","last_unstale":"2024-09-17T16:39:27.521775+0000","last_undegraded":"2024-09-17T16:39:27.521775+0000","last_fullsized":"2024-09-17T16:39:27.521775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:05.162593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044059299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"19'4224","reported_seq":285679,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.730694+0000","last_change":"2024-09-17T16:35:23.137985+0000","last_active":"2024-09-17T16:42:23.730694+0000","last_peered":"2024-09-17T16:42:23.730694+0000","last_clean":"2024-09-17T16:42:23.730694+0000","last_became_active":"2024-09-17T16:35:23.137624+0000","last_became_peered":"2024-09-17T16:35:23.137624+0000","last_unstale":"2024-09-17T16:42:23.730694+0000","last_undegraded":"2024-09-17T16:42:23.730694+0000","last_fullsized":"2024-09-17T16:42:23.730694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:24:25.523270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":281437,"num_read_kb":18011968,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.573596+0000","last_change":"2024-09-17T16:35:16.784770+0000","last_active":"2024-09-17T16:39:37.573596+0000","last_peered":"2024-09-17T16:39:37.573596+0000","last_clean":"2024-09-17T16:39:37.573596+0000","last_became_active":"2024-09-17T16:35:14.065678+0000","last_became_peered":"2024-09-17T16:35:14.065678+0000","last_unstale":"2024-09-17T16:39:37.573596+0000","last_undegraded":"2024-09-17T16:39:37.573596+0000","last_fullsized":"2024-09-17T16:39:37.573596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:04:47.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041479400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.517802+0000","last_change":"2024-09-17T16:35:15.500105+0000","last_active":"2024-09-17T16:39:37.517802+0000","last_peered":"2024-09-17T16:39:37.517802+0000","last_clean":"2024-09-17T16:39:37.517802+0000","last_became_active":"2024-09-17T16:35:14.134094+0000","last_became_peered":"2024-09-17T16:35:14.134094+0000","last_unstale":"2024-09-17T16:39:37.517802+0000","last_undegraded":"2024-09-17T16:39:37.517802+0000","last_fullsized":"2024-09-17T16:39:37.517802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:52.933293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037500100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"19'4016","reported_seq":311085,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734719+0000","last_change":"2024-09-17T16:42:23.704022+0000","last_active":"2024-09-17T16:42:23.734719+0000","last_peered":"2024-09-17T16:42:23.734719+0000","last_clean":"2024-09-17T16:42:23.734719+0000","last_became_active":"2024-09-17T16:35:23.137988+0000","last_became_peered":"2024-09-17T16:35:23.137988+0000","last_unstale":"2024-09-17T16:42:23.734719+0000","last_undegraded":"2024-09-17T16:42:23.734719+0000","last_fullsized":"2024-09-17T16:42:23.734719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:11:40.045121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":268275,"num_read_kb":17169600,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5571,"num_bytes_recovered":5841616896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5571},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4787732504,"num_objects":4567,"num_object_clones":0,"num_object_copies":13701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4567,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73056,"num_write_kb":4675521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":897712128,"data_stored":14363197512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":0,"internal_metadata":0},"log_size":73056,"ondisk_log_size":73056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640346,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138796,"kb_used_data":89564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94233044,"statfs":{"total":96636764160,"available":96494637056,"internally_reserved":0,"allocated":91713536,"data_stored":1464847463,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640347,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228852,"kb_used_data":143588,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94142988,"statfs":{"total":96636764160,"available":96402419712,"internally_reserved":0,"allocated":147034112,"data_stored":2349911162,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640347,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254320,"kb_used_data":182880,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94117520,"statfs":{"total":96636764160,"available":96376340480,"internally_reserved":0,"allocated":187269120,"data_stored":2993671295,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640347,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155124,"kb_used_data":110052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94216716,"statfs":{"total":96636764160,"available":96477917184,"internally_reserved":0,"allocated":112693248,"data_stored":1800457343,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460468,"kb_used_data":168356,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93911372,"statfs":{"total":96636764160,"available":96165244928,"internally_reserved":0,"allocated":172396544,"data_stored":2755710079,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640347,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258800,"kb_used_data":183200,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94113040,"statfs":{"total":96636764160,"available":96371752960,"internally_reserved":0,"allocated":187596800,"data_stored":2998914170,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187428864,"data_stored":2998861824,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172232704,"data_stored":2755657752,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112529408,"data_stored":1800405016,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187105280,"data_stored":2993618968,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":146866176,"data_stored":2349858816,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":91549696,"data_stored":1464795136,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:35.484 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T16:42:35.484 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:35.764 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:42:35.764 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-17T16:42:35.776 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-09-17T16:42:34.558588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4787732523,"num_objects":4569,"num_object_clones":0,"num_object_copies":13705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4569,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73058,"num_write_kb":4675523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73059,"ondisk_log_size":73059,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1496360,"kb_used_data":877640,"kb_used_omap":9,"kb_used_meta":618614,"kb_avail":564734680,"statfs":{"total":579820584960,"available":578288312320,"internally_reserved":0,"allocated":898703360,"data_stored":14363511512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":9568,"internal_metadata":633461408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-1,"num_objects_missing":0,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72510,"num_read_kb":4640640,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":498,"num_bytes_recovered":522190848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":498},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003414"},"pg_stats":[{"pgid":"2.f","version":"19'4416","reported_seq":300365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733259+0000","last_change":"2024-09-17T16:35:23.135379+0000","last_active":"2024-09-17T16:42:23.733259+0000","last_peered":"2024-09-17T16:42:23.733259+0000","last_clean":"2024-09-17T16:42:23.733259+0000","last_became_active":"2024-09-17T16:35:23.135050+0000","last_became_peered":"2024-09-17T16:35:23.135050+0000","last_unstale":"2024-09-17T16:42:23.733259+0000","last_undegraded":"2024-09-17T16:42:23.733259+0000","last_fullsized":"2024-09-17T16:42:23.733259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4416,"log_dups_size":0,"ondisk_log_size":4416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:07:06.939078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":276,"num_whiteouts":0,"num_read":295931,"num_read_kb":18939584,"num_write":4416,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"19'4512","reported_seq":305618,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.732760+0000","last_change":"2024-09-17T16:35:23.135317+0000","last_active":"2024-09-17T16:42:23.732760+0000","last_peered":"2024-09-17T16:42:23.732760+0000","last_clean":"2024-09-17T16:42:23.732760+0000","last_became_active":"2024-09-17T16:35:23.134919+0000","last_became_peered":"2024-09-17T16:35:23.134919+0000","last_unstale":"2024-09-17T16:42:23.732760+0000","last_undegraded":"2024-09-17T16:42:23.732760+0000","last_fullsized":"2024-09-17T16:42:23.732760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:44.510767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":301088,"num_read_kb":19269632,"num_write":4512,"num_write_kb":288768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'4513","reported_seq":346591,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733678+0000","last_change":"2024-09-17T16:42:23.689863+0000","last_active":"2024-09-17T16:42:23.733678+0000","last_peered":"2024-09-17T16:42:23.733678+0000","last_clean":"2024-09-17T16:42:23.733678+0000","last_became_active":"2024-09-17T16:35:23.134864+0000","last_became_peered":"2024-09-17T16:35:23.134864+0000","last_unstale":"2024-09-17T16:42:23.733678+0000","last_undegraded":"2024-09-17T16:42:23.733678+0000","last_fullsized":"2024-09-17T16:42:23.733678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:56.394362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":300158,"num_read_kb":19210049,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6029,"num_bytes_recovered":6321864704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6029},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"19'4672","reported_seq":316214,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.731933+0000","last_change":"2024-09-17T16:35:23.135621+0000","last_active":"2024-09-17T16:42:23.731933+0000","last_peered":"2024-09-17T16:42:23.731933+0000","last_clean":"2024-09-17T16:42:23.731933+0000","last_became_active":"2024-09-17T16:35:23.135226+0000","last_became_peered":"2024-09-17T16:35:23.135226+0000","last_unstale":"2024-09-17T16:42:23.731933+0000","last_undegraded":"2024-09-17T16:42:23.731933+0000","last_fullsized":"2024-09-17T16:42:23.731933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4672,"log_dups_size":0,"ondisk_log_size":4672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:18.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":292,"num_whiteouts":0,"num_read":311524,"num_read_kb":19937536,"num_write":4672,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"19'4144","reported_seq":280756,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734487+0000","last_change":"2024-09-17T16:35:23.137639+0000","last_active":"2024-09-17T16:42:23.734487+0000","last_peered":"2024-09-17T16:42:23.734487+0000","last_clean":"2024-09-17T16:42:23.734487+0000","last_became_active":"2024-09-17T16:35:23.137263+0000","last_became_peered":"2024-09-17T16:35:23.137263+0000","last_unstale":"2024-09-17T16:42:23.734487+0000","last_undegraded":"2024-09-17T16:42:23.734487+0000","last_fullsized":"2024-09-17T16:42:23.734487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:15.149439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":276594,"num_read_kb":17702016,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"19'4976","reported_seq":381993,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735488+0000","last_change":"2024-09-17T16:42:23.734021+0000","last_active":"2024-09-17T16:42:23.735488+0000","last_peered":"2024-09-17T16:42:23.735488+0000","last_clean":"2024-09-17T16:42:23.735488+0000","last_became_active":"2024-09-17T16:35:23.138383+0000","last_became_peered":"2024-09-17T16:35:23.138383+0000","last_unstale":"2024-09-17T16:42:23.735488+0000","last_undegraded":"2024-09-17T16:42:23.735488+0000","last_fullsized":"2024-09-17T16:42:23.735488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4976,"log_dups_size":0,"ondisk_log_size":4976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:07:58.067464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326107136,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":332554,"num_read_kb":21283456,"num_write":4976,"num_write_kb":318464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6410,"num_bytes_recovered":6721372160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6410},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"19'4864","reported_seq":371921,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.742563+0000","last_change":"2024-09-17T16:42:23.743006+0000","last_active":"2024-09-17T16:42:23.742563+0000","last_peered":"2024-09-17T16:42:23.742563+0000","last_clean":"2024-09-17T16:42:23.742563+0000","last_became_active":"2024-09-17T16:35:23.138087+0000","last_became_peered":"2024-09-17T16:35:23.138087+0000","last_unstale":"2024-09-17T16:42:23.742563+0000","last_undegraded":"2024-09-17T16:42:23.742563+0000","last_fullsized":"2024-09-17T16:42:23.742563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:59:19.420126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":323970,"num_read_kb":20734080,"num_write":4864,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6204,"num_bytes_recovered":6505365504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6204},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"19'4735","reported_seq":319463,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735174+0000","last_change":"2024-09-17T16:35:23.135669+0000","last_active":"2024-09-17T16:42:23.735174+0000","last_peered":"2024-09-17T16:42:23.735174+0000","last_clean":"2024-09-17T16:42:23.735174+0000","last_became_active":"2024-09-17T16:35:23.135186+0000","last_became_peered":"2024-09-17T16:35:23.135186+0000","last_unstale":"2024-09-17T16:42:23.735174+0000","last_undegraded":"2024-09-17T16:42:23.735174+0000","last_fullsized":"2024-09-17T16:42:23.735174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:03:24.729635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310312960,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":296,"num_whiteouts":0,"num_read":314710,"num_read_kb":20141440,"num_write":4735,"num_write_kb":303040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:17.569139+0000","last_change":"2024-09-17T16:35:16.784739+0000","last_active":"2024-09-17T16:39:17.569139+0000","last_peered":"2024-09-17T16:39:17.569139+0000","last_clean":"2024-09-17T16:39:17.569139+0000","last_became_active":"2024-09-17T16:35:14.065657+0000","last_became_peered":"2024-09-17T16:35:14.065657+0000","last_unstale":"2024-09-17T16:39:17.569139+0000","last_undegraded":"2024-09-17T16:39:17.569139+0000","last_fullsized":"2024-09-17T16:39:17.569139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:21.720866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000412882,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'4448","reported_seq":301075,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.736160+0000","last_change":"2024-09-17T16:35:23.132819+0000","last_active":"2024-09-17T16:42:23.736160+0000","last_peered":"2024-09-17T16:42:23.736160+0000","last_clean":"2024-09-17T16:42:23.736160+0000","last_became_active":"2024-09-17T16:35:23.132603+0000","last_became_peered":"2024-09-17T16:35:23.132603+0000","last_unstale":"2024-09-17T16:42:23.736160+0000","last_undegraded":"2024-09-17T16:42:23.736160+0000","last_fullsized":"2024-09-17T16:42:23.736160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:01:22.889192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":296609,"num_read_kb":18982976,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.516457+0000","last_change":"2024-09-17T16:35:15.500097+0000","last_active":"2024-09-17T16:39:27.516457+0000","last_peered":"2024-09-17T16:39:27.516457+0000","last_clean":"2024-09-17T16:39:27.516457+0000","last_became_active":"2024-09-17T16:35:14.065746+0000","last_became_peered":"2024-09-17T16:35:14.065746+0000","last_unstale":"2024-09-17T16:39:27.516457+0000","last_undegraded":"2024-09-17T16:39:27.516457+0000","last_fullsized":"2024-09-17T16:39:27.516457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:46:37.495177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038337499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'4608","reported_seq":311295,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734824+0000","last_change":"2024-09-17T16:35:23.134619+0000","last_active":"2024-09-17T16:42:23.734824+0000","last_peered":"2024-09-17T16:42:23.734824+0000","last_clean":"2024-09-17T16:42:23.734824+0000","last_became_active":"2024-09-17T16:35:23.134260+0000","last_became_peered":"2024-09-17T16:35:23.134260+0000","last_unstale":"2024-09-17T16:42:23.734824+0000","last_undegraded":"2024-09-17T16:42:23.734824+0000","last_fullsized":"2024-09-17T16:42:23.734824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:04:54.619111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":306669,"num_read_kb":19626816,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521741+0000","last_change":"2024-09-17T16:35:15.509160+0000","last_active":"2024-09-17T16:39:27.521741+0000","last_peered":"2024-09-17T16:39:27.521741+0000","last_clean":"2024-09-17T16:39:27.521741+0000","last_became_active":"2024-09-17T16:35:14.065650+0000","last_became_peered":"2024-09-17T16:35:14.065650+0000","last_unstale":"2024-09-17T16:39:27.521741+0000","last_undegraded":"2024-09-17T16:39:27.521741+0000","last_fullsized":"2024-09-17T16:39:27.521741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:16.659322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000933667,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"19'5024","reported_seq":339260,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733158+0000","last_change":"2024-09-17T16:35:23.133615+0000","last_active":"2024-09-17T16:42:23.733158+0000","last_peered":"2024-09-17T16:42:23.733158+0000","last_clean":"2024-09-17T16:42:23.733158+0000","last_became_active":"2024-09-17T16:35:23.133244+0000","last_became_peered":"2024-09-17T16:35:23.133244+0000","last_unstale":"2024-09-17T16:42:23.733158+0000","last_undegraded":"2024-09-17T16:42:23.733158+0000","last_fullsized":"2024-09-17T16:42:23.733158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":5024,"log_dups_size":0,"ondisk_log_size":5024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:56.396416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329252864,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":334218,"num_read_kb":21389952,"num_write":5024,"num_write_kb":321536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":32,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621790+0000","last_change":"2024-09-17T16:35:16.155753+0000","last_active":"2024-09-17T16:39:27.621790+0000","last_peered":"2024-09-17T16:39:27.621790+0000","last_clean":"2024-09-17T16:39:27.621790+0000","last_became_active":"2024-09-17T16:35:13.497657+0000","last_became_peered":"2024-09-17T16:35:13.497657+0000","last_unstale":"2024-09-17T16:39:27.621790+0000","last_undegraded":"2024-09-17T16:39:27.621790+0000","last_fullsized":"2024-09-17T16:39:27.621790+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:09.210991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034153500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"19'4688","reported_seq":316270,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734735+0000","last_change":"2024-09-17T16:35:23.134860+0000","last_active":"2024-09-17T16:42:23.734735+0000","last_peered":"2024-09-17T16:42:23.734735+0000","last_clean":"2024-09-17T16:42:23.734735+0000","last_became_active":"2024-09-17T16:35:23.134320+0000","last_became_peered":"2024-09-17T16:35:23.134320+0000","last_unstale":"2024-09-17T16:42:23.734735+0000","last_undegraded":"2024-09-17T16:42:23.734735+0000","last_fullsized":"2024-09-17T16:42:23.734735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:02.294929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307232768,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":293,"num_whiteouts":0,"num_read":311564,"num_read_kb":19940096,"num_write":4688,"num_write_kb":300032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'4304","reported_seq":291594,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734728+0000","last_change":"2024-09-17T16:35:23.137829+0000","last_active":"2024-09-17T16:42:23.734728+0000","last_peered":"2024-09-17T16:42:23.734728+0000","last_clean":"2024-09-17T16:42:23.734728+0000","last_became_active":"2024-09-17T16:35:23.137488+0000","last_became_peered":"2024-09-17T16:35:23.137488+0000","last_unstale":"2024-09-17T16:42:23.734728+0000","last_undegraded":"2024-09-17T16:42:23.734728+0000","last_fullsized":"2024-09-17T16:42:23.734728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:55:39.730046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282066944,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":287272,"num_read_kb":18385408,"num_write":4304,"num_write_kb":275456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621812+0000","last_change":"2024-09-17T16:35:16.155752+0000","last_active":"2024-09-17T16:39:27.621812+0000","last_peered":"2024-09-17T16:39:27.621812+0000","last_clean":"2024-09-17T16:39:27.621812+0000","last_became_active":"2024-09-17T16:35:13.496006+0000","last_became_peered":"2024-09-17T16:35:13.496006+0000","last_unstale":"2024-09-17T16:39:27.621812+0000","last_undegraded":"2024-09-17T16:39:27.621812+0000","last_fullsized":"2024-09-17T16:39:27.621812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:35.483232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000358735,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'4912","reported_seq":376619,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.737701+0000","last_change":"2024-09-17T16:42:23.737842+0000","last_active":"2024-09-17T16:42:23.737701+0000","last_peered":"2024-09-17T16:42:23.737701+0000","last_clean":"2024-09-17T16:42:23.737701+0000","last_became_active":"2024-09-17T16:35:23.138201+0000","last_became_peered":"2024-09-17T16:35:23.138201+0000","last_unstale":"2024-09-17T16:42:23.737701+0000","last_undegraded":"2024-09-17T16:42:23.737701+0000","last_fullsized":"2024-09-17T16:42:23.737701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4912,"log_dups_size":0,"ondisk_log_size":4912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:16:58.832234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":321912832,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":307,"num_whiteouts":0,"num_read":327425,"num_read_kb":20955200,"num_write":4912,"num_write_kb":314368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6380,"num_bytes_recovered":6689914880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6380},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521775+0000","last_change":"2024-09-17T16:35:15.508716+0000","last_active":"2024-09-17T16:39:27.521775+0000","last_peered":"2024-09-17T16:39:27.521775+0000","last_clean":"2024-09-17T16:39:27.521775+0000","last_became_active":"2024-09-17T16:35:14.134117+0000","last_became_peered":"2024-09-17T16:35:14.134117+0000","last_unstale":"2024-09-17T16:39:27.521775+0000","last_undegraded":"2024-09-17T16:39:27.521775+0000","last_fullsized":"2024-09-17T16:39:27.521775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:05.162593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044059299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"19'4224","reported_seq":285679,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.730694+0000","last_change":"2024-09-17T16:35:23.137985+0000","last_active":"2024-09-17T16:42:23.730694+0000","last_peered":"2024-09-17T16:42:23.730694+0000","last_clean":"2024-09-17T16:42:23.730694+0000","last_became_active":"2024-09-17T16:35:23.137624+0000","last_became_peered":"2024-09-17T16:35:23.137624+0000","last_unstale":"2024-09-17T16:42:23.730694+0000","last_undegraded":"2024-09-17T16:42:23.730694+0000","last_fullsized":"2024-09-17T16:42:23.730694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:24:25.523270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":281437,"num_read_kb":18011968,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.573596+0000","last_change":"2024-09-17T16:35:16.784770+0000","last_active":"2024-09-17T16:39:37.573596+0000","last_peered":"2024-09-17T16:39:37.573596+0000","last_clean":"2024-09-17T16:39:37.573596+0000","last_became_active":"2024-09-17T16:35:14.065678+0000","last_became_peered":"2024-09-17T16:35:14.065678+0000","last_unstale":"2024-09-17T16:39:37.573596+0000","last_undegraded":"2024-09-17T16:39:37.573596+0000","last_fullsized":"2024-09-17T16:39:37.573596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:04:47.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041479400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.517802+0000","last_change":"2024-09-17T16:35:15.500105+0000","last_active":"2024-09-17T16:39:37.517802+0000","last_peered":"2024-09-17T16:39:37.517802+0000","last_clean":"2024-09-17T16:39:37.517802+0000","last_became_active":"2024-09-17T16:35:14.134094+0000","last_became_peered":"2024-09-17T16:35:14.134094+0000","last_unstale":"2024-09-17T16:39:37.517802+0000","last_undegraded":"2024-09-17T16:39:37.517802+0000","last_fullsized":"2024-09-17T16:39:37.517802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:52.933293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037500100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"19'4016","reported_seq":311085,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734719+0000","last_change":"2024-09-17T16:42:23.704022+0000","last_active":"2024-09-17T16:42:23.734719+0000","last_peered":"2024-09-17T16:42:23.734719+0000","last_clean":"2024-09-17T16:42:23.734719+0000","last_became_active":"2024-09-17T16:35:23.137988+0000","last_became_peered":"2024-09-17T16:35:23.137988+0000","last_unstale":"2024-09-17T16:42:23.734719+0000","last_undegraded":"2024-09-17T16:42:23.734719+0000","last_fullsized":"2024-09-17T16:42:23.734719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:11:40.045121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":268275,"num_read_kb":17169600,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5571,"num_bytes_recovered":5841616896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5571},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4787732504,"num_objects":4567,"num_object_clones":0,"num_object_copies":13701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4567,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73056,"num_write_kb":4675521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":897712128,"data_stored":14363197512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":0,"internal_metadata":0},"log_size":73056,"ondisk_log_size":73056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640346,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138796,"kb_used_data":89564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94233044,"statfs":{"total":96636764160,"available":96494637056,"internally_reserved":0,"allocated":91713536,"data_stored":1464847463,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640347,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228852,"kb_used_data":143588,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94142988,"statfs":{"total":96636764160,"available":96402419712,"internally_reserved":0,"allocated":147034112,"data_stored":2349911162,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640347,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254320,"kb_used_data":182880,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94117520,"statfs":{"total":96636764160,"available":96376340480,"internally_reserved":0,"allocated":187269120,"data_stored":2993671295,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640347,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155124,"kb_used_data":110052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94216716,"statfs":{"total":96636764160,"available":96477917184,"internally_reserved":0,"allocated":112693248,"data_stored":1800457343,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640346,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460468,"kb_used_data":168356,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93911372,"statfs":{"total":96636764160,"available":96165244928,"internally_reserved":0,"allocated":172396544,"data_stored":2755710079,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640347,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258800,"kb_used_data":183200,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94113040,"statfs":{"total":96636764160,"available":96371752960,"internally_reserved":0,"allocated":187596800,"data_stored":2998914170,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187428864,"data_stored":2998861824,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172232704,"data_stored":2755657752,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112529408,"data_stored":1800405016,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187105280,"data_stored":2993618968,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":146866176,"data_stored":2349858816,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":91549696,"data_stored":1464795136,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:35.777 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":19,"fsid":"dc020b28-a66a-430c-bfac-6db0c0fa2d85","created":"2024-09-17T16:35:02.125273+0000","modified":"2024-09-17T16:35:24.124998+0000","last_up_change":"2024-09-17T16:35:11.479640+0000","last_in_change":"2024-09-17T16:35:03.861357+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-17T16:35:12.045731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"test","create_time":"2024-09-17T16:35:21.027671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69372453-cb9e-4722-bdc6-ae38828a3e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6804","nonce":877413202}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6805","nonce":877413202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6807","nonce":877413202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6806","nonce":877413202}]},"public_addr":"172.21.15.138:6804/877413202","cluster_addr":"172.21.15.138:6805/877413202","heartbeat_back_addr":"172.21.15.138:6807/877413202","heartbeat_front_addr":"172.21.15.138:6806/877413202","state":["exists","up"]},{"osd":1,"uuid":"35b4cc41-f510-4862-8272-3bcf51ea9aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6808","nonce":258902983}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6809","nonce":258902983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6811","nonce":258902983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6810","nonce":258902983}]},"public_addr":"172.21.15.138:6808/258902983","cluster_addr":"172.21.15.138:6809/258902983","heartbeat_back_addr":"172.21.15.138:6811/258902983","heartbeat_front_addr":"172.21.15.138:6810/258902983","state":["exists","up"]},{"osd":2,"uuid":"b69d2fce-7d7e-42c1-ba59-ae017110f2f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6800","nonce":1957284935}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6801","nonce":1957284935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6803","nonce":1957284935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.138:6802","nonce":1957284935}]},"public_addr":"172.21.15.138:6800/1957284935","cluster_addr":"172.21.15.138:6801/1957284935","heartbeat_back_addr":"172.21.15.138:6803/1957284935","heartbeat_front_addr":"172.21.15.138:6802/1957284935","state":["exists","up"]},{"osd":3,"uuid":"31ee1393-4a94-4405-8b7d-497316f6bc1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6800","nonce":48802958}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6801","nonce":48802958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6803","nonce":48802958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6802","nonce":48802958}]},"public_addr":"172.21.15.165:6800/48802958","cluster_addr":"172.21.15.165:6801/48802958","heartbeat_back_addr":"172.21.15.165:6803/48802958","heartbeat_front_addr":"172.21.15.165:6802/48802958","state":["exists","up"]},{"osd":4,"uuid":"24593cf4-3cbc-43bc-a137-b0f41fab4122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6804","nonce":2839896858}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6805","nonce":2839896858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6807","nonce":2839896858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6806","nonce":2839896858}]},"public_addr":"172.21.15.165:6804/2839896858","cluster_addr":"172.21.15.165:6805/2839896858","heartbeat_back_addr":"172.21.15.165:6807/2839896858","heartbeat_front_addr":"172.21.15.165:6806/2839896858","state":["exists","up"]},{"osd":5,"uuid":"6b0dc9fc-b887-46ab-8057-e7c32d5a7132","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6808","nonce":3866589657}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6809","nonce":3866589657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6811","nonce":3866589657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.165:6810","nonce":3866589657}]},"public_addr":"172.21.15.165:6808/3866589657","cluster_addr":"172.21.15.165:6809/3866589657","heartbeat_back_addr":"172.21.15.165:6811/3866589657","heartbeat_front_addr":"172.21.15.165:6810/3866589657","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.348590+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.191411+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.418976+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:09.842945+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.376091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:35:10.020253+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:42:37.072 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T16:42:37.073 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:42:37.194 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-17T16:42:37.194 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:42:37.194 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-17T16:42:37.204 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T16:42:37.495 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T16:42:37.507 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T16:42:37.507 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:42:37.629 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-17T16:42:37.629 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:42:37.629 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-17T16:42:37.639 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T16:42:37.927 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T16:42:37.941 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T16:42:37.941 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:42:38.061 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-17T16:42:38.061 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:42:38.061 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-17T16:42:38.071 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T16:42:38.355 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T16:42:38.368 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T16:42:38.368 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-17T16:42:38.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T16:42:38.890 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T16:42:38.907 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T16:42:38.908 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:42:39.069 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-17T16:42:39.069 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:42:39.070 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-17T16:42:39.082 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T16:42:39.497 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T16:42:39.497 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:42:39.655 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-17T16:42:39.655 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:42:39.655 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-17T16:42:39.671 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T16:42:40.057 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T16:42:40.070 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:40.433 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:42:40.433 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-17T16:42:40.446 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-09-17T16:42:38.559739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4787732523,"num_objects":4569,"num_object_clones":0,"num_object_copies":13705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4569,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73058,"num_write_kb":4675523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73059,"ondisk_log_size":73059,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1496360,"kb_used_data":877640,"kb_used_omap":9,"kb_used_meta":618614,"kb_avail":564734680,"statfs":{"total":579820584960,"available":578288312320,"internally_reserved":0,"allocated":898703360,"data_stored":14363511512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":9568,"internal_metadata":633461408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-2,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14810,"num_read_kb":947840,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":89128960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":85},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003266"},"pg_stats":[{"pgid":"2.f","version":"19'4416","reported_seq":300365,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733259+0000","last_change":"2024-09-17T16:35:23.135379+0000","last_active":"2024-09-17T16:42:23.733259+0000","last_peered":"2024-09-17T16:42:23.733259+0000","last_clean":"2024-09-17T16:42:23.733259+0000","last_became_active":"2024-09-17T16:35:23.135050+0000","last_became_peered":"2024-09-17T16:35:23.135050+0000","last_unstale":"2024-09-17T16:42:23.733259+0000","last_undegraded":"2024-09-17T16:42:23.733259+0000","last_fullsized":"2024-09-17T16:42:23.733259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4416,"log_dups_size":0,"ondisk_log_size":4416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:07:06.939078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":276,"num_whiteouts":0,"num_read":295931,"num_read_kb":18939584,"num_write":4416,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"19'4512","reported_seq":305618,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.732760+0000","last_change":"2024-09-17T16:35:23.135317+0000","last_active":"2024-09-17T16:42:23.732760+0000","last_peered":"2024-09-17T16:42:23.732760+0000","last_clean":"2024-09-17T16:42:23.732760+0000","last_became_active":"2024-09-17T16:35:23.134919+0000","last_became_peered":"2024-09-17T16:35:23.134919+0000","last_unstale":"2024-09-17T16:42:23.732760+0000","last_undegraded":"2024-09-17T16:42:23.732760+0000","last_fullsized":"2024-09-17T16:42:23.732760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4512,"log_dups_size":0,"ondisk_log_size":4512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:44.510767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":301088,"num_read_kb":19269632,"num_write":4512,"num_write_kb":288768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'4513","reported_seq":346591,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733678+0000","last_change":"2024-09-17T16:42:23.689863+0000","last_active":"2024-09-17T16:42:23.733678+0000","last_peered":"2024-09-17T16:42:23.733678+0000","last_clean":"2024-09-17T16:42:23.733678+0000","last_became_active":"2024-09-17T16:35:23.134864+0000","last_became_peered":"2024-09-17T16:35:23.134864+0000","last_unstale":"2024-09-17T16:42:23.733678+0000","last_undegraded":"2024-09-17T16:42:23.733678+0000","last_fullsized":"2024-09-17T16:42:23.733678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4513,"log_dups_size":0,"ondisk_log_size":4513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:24:56.394362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":300158,"num_read_kb":19210049,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6029,"num_bytes_recovered":6321864704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6029},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"19'4672","reported_seq":316214,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.731933+0000","last_change":"2024-09-17T16:35:23.135621+0000","last_active":"2024-09-17T16:42:23.731933+0000","last_peered":"2024-09-17T16:42:23.731933+0000","last_clean":"2024-09-17T16:42:23.731933+0000","last_became_active":"2024-09-17T16:35:23.135226+0000","last_became_peered":"2024-09-17T16:35:23.135226+0000","last_unstale":"2024-09-17T16:42:23.731933+0000","last_undegraded":"2024-09-17T16:42:23.731933+0000","last_fullsized":"2024-09-17T16:42:23.731933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4672,"log_dups_size":0,"ondisk_log_size":4672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:18.238526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":292,"num_whiteouts":0,"num_read":311524,"num_read_kb":19937536,"num_write":4672,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"19'4144","reported_seq":280756,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734487+0000","last_change":"2024-09-17T16:35:23.137639+0000","last_active":"2024-09-17T16:42:23.734487+0000","last_peered":"2024-09-17T16:42:23.734487+0000","last_clean":"2024-09-17T16:42:23.734487+0000","last_became_active":"2024-09-17T16:35:23.137263+0000","last_became_peered":"2024-09-17T16:35:23.137263+0000","last_unstale":"2024-09-17T16:42:23.734487+0000","last_undegraded":"2024-09-17T16:42:23.734487+0000","last_fullsized":"2024-09-17T16:42:23.734487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4144,"log_dups_size":0,"ondisk_log_size":4144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:58:15.149439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":276594,"num_read_kb":17702016,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"19'4976","reported_seq":381993,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735488+0000","last_change":"2024-09-17T16:42:23.734021+0000","last_active":"2024-09-17T16:42:23.735488+0000","last_peered":"2024-09-17T16:42:23.735488+0000","last_clean":"2024-09-17T16:42:23.735488+0000","last_became_active":"2024-09-17T16:35:23.138383+0000","last_became_peered":"2024-09-17T16:35:23.138383+0000","last_unstale":"2024-09-17T16:42:23.735488+0000","last_undegraded":"2024-09-17T16:42:23.735488+0000","last_fullsized":"2024-09-17T16:42:23.735488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4976,"log_dups_size":0,"ondisk_log_size":4976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:07:58.067464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326107136,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":332554,"num_read_kb":21283456,"num_write":4976,"num_write_kb":318464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6410,"num_bytes_recovered":6721372160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6410},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"19'4864","reported_seq":371921,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.742563+0000","last_change":"2024-09-17T16:42:23.743006+0000","last_active":"2024-09-17T16:42:23.742563+0000","last_peered":"2024-09-17T16:42:23.742563+0000","last_clean":"2024-09-17T16:42:23.742563+0000","last_became_active":"2024-09-17T16:35:23.138087+0000","last_became_peered":"2024-09-17T16:35:23.138087+0000","last_unstale":"2024-09-17T16:42:23.742563+0000","last_undegraded":"2024-09-17T16:42:23.742563+0000","last_fullsized":"2024-09-17T16:42:23.742563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4864,"log_dups_size":0,"ondisk_log_size":4864,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:59:19.420126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":323970,"num_read_kb":20734080,"num_write":4864,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6204,"num_bytes_recovered":6505365504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6204},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"19'4735","reported_seq":319463,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.735174+0000","last_change":"2024-09-17T16:35:23.135669+0000","last_active":"2024-09-17T16:42:23.735174+0000","last_peered":"2024-09-17T16:42:23.735174+0000","last_clean":"2024-09-17T16:42:23.735174+0000","last_became_active":"2024-09-17T16:35:23.135186+0000","last_became_peered":"2024-09-17T16:35:23.135186+0000","last_unstale":"2024-09-17T16:42:23.735174+0000","last_undegraded":"2024-09-17T16:42:23.735174+0000","last_fullsized":"2024-09-17T16:42:23.735174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:03:24.729635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310312960,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":296,"num_whiteouts":0,"num_read":314710,"num_read_kb":20141440,"num_write":4735,"num_write_kb":303040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:17.569139+0000","last_change":"2024-09-17T16:35:16.784739+0000","last_active":"2024-09-17T16:39:17.569139+0000","last_peered":"2024-09-17T16:39:17.569139+0000","last_clean":"2024-09-17T16:39:17.569139+0000","last_became_active":"2024-09-17T16:35:14.065657+0000","last_became_peered":"2024-09-17T16:35:14.065657+0000","last_unstale":"2024-09-17T16:39:17.569139+0000","last_undegraded":"2024-09-17T16:39:17.569139+0000","last_fullsized":"2024-09-17T16:39:17.569139+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:22:21.720866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000412882,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'4448","reported_seq":301075,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.736160+0000","last_change":"2024-09-17T16:35:23.132819+0000","last_active":"2024-09-17T16:42:23.736160+0000","last_peered":"2024-09-17T16:42:23.736160+0000","last_clean":"2024-09-17T16:42:23.736160+0000","last_became_active":"2024-09-17T16:35:23.132603+0000","last_became_peered":"2024-09-17T16:35:23.132603+0000","last_unstale":"2024-09-17T16:42:23.736160+0000","last_undegraded":"2024-09-17T16:42:23.736160+0000","last_fullsized":"2024-09-17T16:42:23.736160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4448,"log_dups_size":0,"ondisk_log_size":4448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:01:22.889192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":296609,"num_read_kb":18982976,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.516457+0000","last_change":"2024-09-17T16:35:15.500097+0000","last_active":"2024-09-17T16:39:27.516457+0000","last_peered":"2024-09-17T16:39:27.516457+0000","last_clean":"2024-09-17T16:39:27.516457+0000","last_became_active":"2024-09-17T16:35:14.065746+0000","last_became_peered":"2024-09-17T16:35:14.065746+0000","last_unstale":"2024-09-17T16:39:27.516457+0000","last_undegraded":"2024-09-17T16:39:27.516457+0000","last_fullsized":"2024-09-17T16:39:27.516457+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:46:37.495177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038337499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'4608","reported_seq":311295,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734824+0000","last_change":"2024-09-17T16:35:23.134619+0000","last_active":"2024-09-17T16:42:23.734824+0000","last_peered":"2024-09-17T16:42:23.734824+0000","last_clean":"2024-09-17T16:42:23.734824+0000","last_became_active":"2024-09-17T16:35:23.134260+0000","last_became_peered":"2024-09-17T16:35:23.134260+0000","last_unstale":"2024-09-17T16:42:23.734824+0000","last_undegraded":"2024-09-17T16:42:23.734824+0000","last_fullsized":"2024-09-17T16:42:23.734824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4608,"log_dups_size":0,"ondisk_log_size":4608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:04:54.619111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":306669,"num_read_kb":19626816,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":33,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521741+0000","last_change":"2024-09-17T16:35:15.509160+0000","last_active":"2024-09-17T16:39:27.521741+0000","last_peered":"2024-09-17T16:39:27.521741+0000","last_clean":"2024-09-17T16:39:27.521741+0000","last_became_active":"2024-09-17T16:35:14.065650+0000","last_became_peered":"2024-09-17T16:35:14.065650+0000","last_unstale":"2024-09-17T16:39:27.521741+0000","last_undegraded":"2024-09-17T16:39:27.521741+0000","last_fullsized":"2024-09-17T16:39:27.521741+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:26:16.659322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000933667,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"19'5024","reported_seq":339260,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.733158+0000","last_change":"2024-09-17T16:35:23.133615+0000","last_active":"2024-09-17T16:42:23.733158+0000","last_peered":"2024-09-17T16:42:23.733158+0000","last_clean":"2024-09-17T16:42:23.733158+0000","last_became_active":"2024-09-17T16:35:23.133244+0000","last_became_peered":"2024-09-17T16:35:23.133244+0000","last_unstale":"2024-09-17T16:42:23.733158+0000","last_undegraded":"2024-09-17T16:42:23.733158+0000","last_fullsized":"2024-09-17T16:42:23.733158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":5024,"log_dups_size":0,"ondisk_log_size":5024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:56.396416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329252864,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":334218,"num_read_kb":21389952,"num_write":5024,"num_write_kb":321536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":32,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621790+0000","last_change":"2024-09-17T16:35:16.155753+0000","last_active":"2024-09-17T16:39:27.621790+0000","last_peered":"2024-09-17T16:39:27.621790+0000","last_clean":"2024-09-17T16:39:27.621790+0000","last_became_active":"2024-09-17T16:35:13.497657+0000","last_became_peered":"2024-09-17T16:35:13.497657+0000","last_unstale":"2024-09-17T16:39:27.621790+0000","last_undegraded":"2024-09-17T16:39:27.621790+0000","last_fullsized":"2024-09-17T16:39:27.621790+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:08:09.210991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034153500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"19'4688","reported_seq":316270,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734735+0000","last_change":"2024-09-17T16:35:23.134860+0000","last_active":"2024-09-17T16:42:23.734735+0000","last_peered":"2024-09-17T16:42:23.734735+0000","last_clean":"2024-09-17T16:42:23.734735+0000","last_became_active":"2024-09-17T16:35:23.134320+0000","last_became_peered":"2024-09-17T16:35:23.134320+0000","last_unstale":"2024-09-17T16:42:23.734735+0000","last_undegraded":"2024-09-17T16:42:23.734735+0000","last_fullsized":"2024-09-17T16:42:23.734735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4688,"log_dups_size":0,"ondisk_log_size":4688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:33:02.294929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307232768,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":293,"num_whiteouts":0,"num_read":311564,"num_read_kb":19940096,"num_write":4688,"num_write_kb":300032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'4304","reported_seq":291594,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734728+0000","last_change":"2024-09-17T16:35:23.137829+0000","last_active":"2024-09-17T16:42:23.734728+0000","last_peered":"2024-09-17T16:42:23.734728+0000","last_clean":"2024-09-17T16:42:23.734728+0000","last_became_active":"2024-09-17T16:35:23.137488+0000","last_became_peered":"2024-09-17T16:35:23.137488+0000","last_unstale":"2024-09-17T16:42:23.734728+0000","last_undegraded":"2024-09-17T16:42:23.734728+0000","last_fullsized":"2024-09-17T16:42:23.734728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:55:39.730046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282066944,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":287272,"num_read_kb":18385408,"num_write":4304,"num_write_kb":275456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.621812+0000","last_change":"2024-09-17T16:35:16.155752+0000","last_active":"2024-09-17T16:39:27.621812+0000","last_peered":"2024-09-17T16:39:27.621812+0000","last_clean":"2024-09-17T16:39:27.621812+0000","last_became_active":"2024-09-17T16:35:13.496006+0000","last_became_peered":"2024-09-17T16:35:13.496006+0000","last_unstale":"2024-09-17T16:39:27.621812+0000","last_undegraded":"2024-09-17T16:39:27.621812+0000","last_fullsized":"2024-09-17T16:39:27.621812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:30:35.483232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000358735,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'4912","reported_seq":376619,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.737701+0000","last_change":"2024-09-17T16:42:23.737842+0000","last_active":"2024-09-17T16:42:23.737701+0000","last_peered":"2024-09-17T16:42:23.737701+0000","last_clean":"2024-09-17T16:42:23.737701+0000","last_became_active":"2024-09-17T16:35:23.138201+0000","last_became_peered":"2024-09-17T16:35:23.138201+0000","last_unstale":"2024-09-17T16:42:23.737701+0000","last_undegraded":"2024-09-17T16:42:23.737701+0000","last_fullsized":"2024-09-17T16:42:23.737701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4912,"log_dups_size":0,"ondisk_log_size":4912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:16:58.832234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":321912832,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":307,"num_whiteouts":0,"num_read":327425,"num_read_kb":20955200,"num_write":4912,"num_write_kb":314368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6380,"num_bytes_recovered":6689914880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6380},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:27.521775+0000","last_change":"2024-09-17T16:35:15.508716+0000","last_active":"2024-09-17T16:39:27.521775+0000","last_peered":"2024-09-17T16:39:27.521775+0000","last_clean":"2024-09-17T16:39:27.521775+0000","last_became_active":"2024-09-17T16:35:14.134117+0000","last_became_peered":"2024-09-17T16:35:14.134117+0000","last_unstale":"2024-09-17T16:39:27.521775+0000","last_undegraded":"2024-09-17T16:39:27.521775+0000","last_fullsized":"2024-09-17T16:39:27.521775+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:03:05.162593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044059299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"19'4224","reported_seq":285679,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.730694+0000","last_change":"2024-09-17T16:35:23.137985+0000","last_active":"2024-09-17T16:42:23.730694+0000","last_peered":"2024-09-17T16:42:23.730694+0000","last_clean":"2024-09-17T16:42:23.730694+0000","last_became_active":"2024-09-17T16:35:23.137624+0000","last_became_peered":"2024-09-17T16:35:23.137624+0000","last_unstale":"2024-09-17T16:42:23.730694+0000","last_undegraded":"2024-09-17T16:42:23.730694+0000","last_fullsized":"2024-09-17T16:42:23.730694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4224,"log_dups_size":0,"ondisk_log_size":4224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:24:25.523270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":281437,"num_read_kb":18011968,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.573596+0000","last_change":"2024-09-17T16:35:16.784770+0000","last_active":"2024-09-17T16:39:37.573596+0000","last_peered":"2024-09-17T16:39:37.573596+0000","last_clean":"2024-09-17T16:39:37.573596+0000","last_became_active":"2024-09-17T16:35:14.065678+0000","last_became_peered":"2024-09-17T16:35:14.065678+0000","last_unstale":"2024-09-17T16:39:37.573596+0000","last_undegraded":"2024-09-17T16:39:37.573596+0000","last_fullsized":"2024-09-17T16:39:37.573596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:04:47.449832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041479400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":29,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:39:37.517802+0000","last_change":"2024-09-17T16:35:15.500105+0000","last_active":"2024-09-17T16:39:37.517802+0000","last_peered":"2024-09-17T16:39:37.517802+0000","last_clean":"2024-09-17T16:39:37.517802+0000","last_became_active":"2024-09-17T16:35:14.134094+0000","last_became_peered":"2024-09-17T16:35:14.134094+0000","last_unstale":"2024-09-17T16:39:37.517802+0000","last_undegraded":"2024-09-17T16:39:37.517802+0000","last_fullsized":"2024-09-17T16:39:37.517802+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:12.483533+0000","last_clean_scrub_stamp":"2024-09-17T16:35:12.483533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:14:52.933293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037500100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"19'4016","reported_seq":311085,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:23.734719+0000","last_change":"2024-09-17T16:42:23.704022+0000","last_active":"2024-09-17T16:42:23.734719+0000","last_peered":"2024-09-17T16:42:23.734719+0000","last_clean":"2024-09-17T16:42:23.734719+0000","last_became_active":"2024-09-17T16:35:23.137988+0000","last_became_peered":"2024-09-17T16:35:23.137988+0000","last_unstale":"2024-09-17T16:42:23.734719+0000","last_undegraded":"2024-09-17T16:42:23.734719+0000","last_fullsized":"2024-09-17T16:42:23.734719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:35:21.511068+0000","last_clean_scrub_stamp":"2024-09-17T16:35:21.511068+0000","objects_scrubbed":0,"log_size":4016,"log_dups_size":0,"ondisk_log_size":4016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:11:40.045121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":268275,"num_read_kb":17169600,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5571,"num_bytes_recovered":5841616896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5571},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4787732504,"num_objects":4567,"num_object_clones":0,"num_object_copies":13701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4567,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73056,"num_write_kb":4675521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":897712128,"data_stored":14363197512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":0,"internal_metadata":0},"log_size":73056,"ondisk_log_size":73056,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640347,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138796,"kb_used_data":89564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94233044,"statfs":{"total":96636764160,"available":96494637056,"internally_reserved":0,"allocated":91713536,"data_stored":1464847463,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640348,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":228852,"kb_used_data":143588,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94142988,"statfs":{"total":96636764160,"available":96402419712,"internally_reserved":0,"allocated":147034112,"data_stored":2349911162,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640348,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254320,"kb_used_data":182880,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94117520,"statfs":{"total":96636764160,"available":96376340480,"internally_reserved":0,"allocated":187269120,"data_stored":2993671295,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":1593,"internal_metadata":73136583},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640348,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155124,"kb_used_data":110052,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94216716,"statfs":{"total":96636764160,"available":96477917184,"internally_reserved":0,"allocated":112693248,"data_stored":1800457343,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640347,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460468,"kb_used_data":168356,"kb_used_omap":1,"kb_used_meta":292094,"kb_avail":93911372,"statfs":{"total":96636764160,"available":96165244928,"internally_reserved":0,"allocated":172396544,"data_stored":2755710079,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":1595,"internal_metadata":299104709},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640348,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258800,"kb_used_data":183200,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94113040,"statfs":{"total":96636764160,"available":96371752960,"internally_reserved":0,"allocated":187596800,"data_stored":2998914170,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187428864,"data_stored":2998861824,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172232704,"data_stored":2755657752,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112529408,"data_stored":1800405016,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187105280,"data_stored":2993618968,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":146866176,"data_stored":2349858816,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":91549696,"data_stored":1464795136,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:40.451 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.451 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.451 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.451 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.451 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.451 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.452 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-09-17T16:35:12.483533+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=12, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.453 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T16:35:21.511068+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=35, tm_sec=21, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=42, tm_sec=36, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:42:40.454 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T16:43:00.454 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:43:00.747 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-17T16:43:00.747 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-17T16:43:00.759 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-09-17T16:43:00.564528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4787732523,"num_objects":4569,"num_object_clones":0,"num_object_copies":13705,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4569,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73058,"num_write_kb":4675523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77628,"ondisk_log_size":77628,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":1546280,"kb_used_data":877640,"kb_used_omap":9,"kb_used_meta":668534,"kb_avail":564684760,"statfs":{"total":579820584960,"available":578237194240,"internally_reserved":0,"allocated":898703360,"data_stored":14363511512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":9568,"internal_metadata":684579488},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002829"},"pg_stats":[{"pgid":"2.f","version":"19'4692","reported_seq":300668,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:43.211430+0000","last_change":"2024-09-17T16:42:43.211430+0000","last_active":"2024-09-17T16:42:43.211430+0000","last_peered":"2024-09-17T16:42:43.211430+0000","last_clean":"2024-09-17T16:42:43.211430+0000","last_became_active":"2024-09-17T16:35:23.135050+0000","last_became_peered":"2024-09-17T16:35:23.135050+0000","last_unstale":"2024-09-17T16:42:43.211430+0000","last_undegraded":"2024-09-17T16:42:43.211430+0000","last_fullsized":"2024-09-17T16:42:43.211430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4692","last_scrub_stamp":"2024-09-17T16:42:43.211322+0000","last_deep_scrub":"19'4692","last_deep_scrub_stamp":"2024-09-17T16:42:43.211322+0000","last_clean_scrub_stamp":"2024-09-17T16:42:43.211322+0000","objects_scrubbed":276,"log_size":4692,"log_dups_size":0,"ondisk_log_size":4692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:32.092256+0000","scrub_duration":1249,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289406976,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":276,"num_whiteouts":0,"num_read":295931,"num_read_kb":18939584,"num_write":4416,"num_write_kb":282624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"19'4794","reported_seq":305926,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:40.451218+0000","last_change":"2024-09-17T16:42:40.451218+0000","last_active":"2024-09-17T16:42:40.451218+0000","last_peered":"2024-09-17T16:42:40.451218+0000","last_clean":"2024-09-17T16:42:40.451218+0000","last_became_active":"2024-09-17T16:35:23.134919+0000","last_became_peered":"2024-09-17T16:35:23.134919+0000","last_unstale":"2024-09-17T16:42:40.451218+0000","last_undegraded":"2024-09-17T16:42:40.451218+0000","last_fullsized":"2024-09-17T16:42:40.451218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4794","last_scrub_stamp":"2024-09-17T16:42:40.451116+0000","last_deep_scrub":"19'4794","last_deep_scrub_stamp":"2024-09-17T16:42:40.451116+0000","last_clean_scrub_stamp":"2024-09-17T16:42:40.451116+0000","objects_scrubbed":282,"log_size":4794,"log_dups_size":0,"ondisk_log_size":4794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:34:08.218631+0000","scrub_duration":829,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698432,"num_objects":282,"num_object_clones":0,"num_object_copies":846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":301088,"num_read_kb":19269632,"num_write":4512,"num_write_kb":288768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"19'4796","reported_seq":346901,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:44.293098+0000","last_change":"2024-09-17T16:42:44.293098+0000","last_active":"2024-09-17T16:42:44.293098+0000","last_peered":"2024-09-17T16:42:44.293098+0000","last_clean":"2024-09-17T16:42:44.293098+0000","last_became_active":"2024-09-17T16:35:23.134864+0000","last_became_peered":"2024-09-17T16:35:23.134864+0000","last_unstale":"2024-09-17T16:42:44.293098+0000","last_undegraded":"2024-09-17T16:42:44.293098+0000","last_fullsized":"2024-09-17T16:42:44.293098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4796","last_scrub_stamp":"2024-09-17T16:42:44.292961+0000","last_deep_scrub":"19'4796","last_deep_scrub_stamp":"2024-09-17T16:42:44.292961+0000","last_clean_scrub_stamp":"2024-09-17T16:42:44.292961+0000","objects_scrubbed":283,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:16:08.843946+0000","scrub_duration":1544,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":295698456,"num_objects":283,"num_object_clones":0,"num_object_copies":849,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":283,"num_whiteouts":0,"num_read":300158,"num_read_kb":19210049,"num_write":4513,"num_write_kb":288769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6029,"num_bytes_recovered":6321864704,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6029},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"19'4964","reported_seq":316533,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.643633+0000","last_change":"2024-09-17T16:42:41.643633+0000","last_active":"2024-09-17T16:42:41.643633+0000","last_peered":"2024-09-17T16:42:41.643633+0000","last_clean":"2024-09-17T16:42:41.643633+0000","last_became_active":"2024-09-17T16:35:23.135226+0000","last_became_peered":"2024-09-17T16:35:23.135226+0000","last_unstale":"2024-09-17T16:42:41.643633+0000","last_undegraded":"2024-09-17T16:42:41.643633+0000","last_fullsized":"2024-09-17T16:42:41.643633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4964","last_scrub_stamp":"2024-09-17T16:42:41.643542+0000","last_deep_scrub":"19'4964","last_deep_scrub_stamp":"2024-09-17T16:42:41.643542+0000","last_clean_scrub_stamp":"2024-09-17T16:42:41.643542+0000","objects_scrubbed":292,"log_size":4964,"log_dups_size":0,"ondisk_log_size":4964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:01:59.514367+0000","scrub_duration":1009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306184192,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":292,"num_whiteouts":0,"num_read":311524,"num_read_kb":19937536,"num_write":4672,"num_write_kb":299008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.b","version":"19'4403","reported_seq":281040,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:46.397270+0000","last_change":"2024-09-17T16:42:46.397270+0000","last_active":"2024-09-17T16:42:46.397270+0000","last_peered":"2024-09-17T16:42:46.397270+0000","last_clean":"2024-09-17T16:42:46.397270+0000","last_became_active":"2024-09-17T16:35:23.137263+0000","last_became_peered":"2024-09-17T16:35:23.137263+0000","last_unstale":"2024-09-17T16:42:46.397270+0000","last_undegraded":"2024-09-17T16:42:46.397270+0000","last_fullsized":"2024-09-17T16:42:46.397270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4403","last_scrub_stamp":"2024-09-17T16:42:46.397190+0000","last_deep_scrub":"19'4403","last_deep_scrub_stamp":"2024-09-17T16:42:46.397190+0000","last_clean_scrub_stamp":"2024-09-17T16:42:46.397190+0000","objects_scrubbed":259,"log_size":4403,"log_dups_size":0,"ondisk_log_size":4403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:45:23.659304+0000","scrub_duration":848,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271581184,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":276594,"num_read_kb":17702016,"num_write":4144,"num_write_kb":265216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,5],"acting":[3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"19'5287","reported_seq":382332,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:46.002624+0000","last_change":"2024-09-17T16:42:46.002624+0000","last_active":"2024-09-17T16:42:46.002624+0000","last_peered":"2024-09-17T16:42:46.002624+0000","last_clean":"2024-09-17T16:42:46.002624+0000","last_became_active":"2024-09-17T16:35:23.138383+0000","last_became_peered":"2024-09-17T16:35:23.138383+0000","last_unstale":"2024-09-17T16:42:46.002624+0000","last_undegraded":"2024-09-17T16:42:46.002624+0000","last_fullsized":"2024-09-17T16:42:46.002624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5287","last_scrub_stamp":"2024-09-17T16:42:46.002540+0000","last_deep_scrub":"19'5287","last_deep_scrub_stamp":"2024-09-17T16:42:46.002540+0000","last_clean_scrub_stamp":"2024-09-17T16:42:46.002540+0000","objects_scrubbed":311,"log_size":5287,"log_dups_size":0,"ondisk_log_size":5287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:16:21.441912+0000","scrub_duration":1209,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":326107136,"num_objects":311,"num_object_clones":0,"num_object_copies":933,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":332554,"num_read_kb":21283456,"num_write":4976,"num_write_kb":318464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6410,"num_bytes_recovered":6721372160,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6410},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"19'5168","reported_seq":372253,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:45.071011+0000","last_change":"2024-09-17T16:42:45.071011+0000","last_active":"2024-09-17T16:42:45.071011+0000","last_peered":"2024-09-17T16:42:45.071011+0000","last_clean":"2024-09-17T16:42:45.071011+0000","last_became_active":"2024-09-17T16:35:23.138087+0000","last_became_peered":"2024-09-17T16:35:23.138087+0000","last_unstale":"2024-09-17T16:42:45.071011+0000","last_undegraded":"2024-09-17T16:42:45.071011+0000","last_fullsized":"2024-09-17T16:42:45.071011+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5168","last_scrub_stamp":"2024-09-17T16:42:45.070939+0000","last_deep_scrub":"19'5168","last_deep_scrub_stamp":"2024-09-17T16:42:45.070939+0000","last_clean_scrub_stamp":"2024-09-17T16:42:45.070939+0000","objects_scrubbed":304,"log_size":5168,"log_dups_size":0,"ondisk_log_size":5168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:52:53.139870+0000","scrub_duration":1306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":323970,"num_read_kb":20734080,"num_write":4864,"num_write_kb":311296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6204,"num_bytes_recovered":6505365504,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6204},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"19'5031","reported_seq":319786,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:45.746979+0000","last_change":"2024-09-17T16:42:45.746979+0000","last_active":"2024-09-17T16:42:45.746979+0000","last_peered":"2024-09-17T16:42:45.746979+0000","last_clean":"2024-09-17T16:42:45.746979+0000","last_became_active":"2024-09-17T16:35:23.135186+0000","last_became_peered":"2024-09-17T16:35:23.135186+0000","last_unstale":"2024-09-17T16:42:45.746979+0000","last_undegraded":"2024-09-17T16:42:45.746979+0000","last_fullsized":"2024-09-17T16:42:45.746979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5031","last_scrub_stamp":"2024-09-17T16:42:45.746844+0000","last_deep_scrub":"19'5031","last_deep_scrub_stamp":"2024-09-17T16:42:45.746844+0000","last_clean_scrub_stamp":"2024-09-17T16:42:45.746844+0000","objects_scrubbed":296,"log_size":5031,"log_dups_size":0,"ondisk_log_size":5031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T22:23:26.191103+0000","scrub_duration":1232,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310312960,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":296,"num_whiteouts":0,"num_read":314710,"num_read_kb":20141440,"num_write":4735,"num_write_kb":303040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0],"acting":[3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":39,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:39.455773+0000","last_change":"2024-09-17T16:42:39.455773+0000","last_active":"2024-09-17T16:42:39.455773+0000","last_peered":"2024-09-17T16:42:39.455773+0000","last_clean":"2024-09-17T16:42:39.455773+0000","last_became_active":"2024-09-17T16:35:14.065657+0000","last_became_peered":"2024-09-17T16:35:14.065657+0000","last_unstale":"2024-09-17T16:42:39.455773+0000","last_undegraded":"2024-09-17T16:42:39.455773+0000","last_fullsized":"2024-09-17T16:42:39.455773+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:39.455657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:39.455657+0000","last_clean_scrub_stamp":"2024-09-17T16:42:39.455657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:21:06.431151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000412882,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"19'4726","reported_seq":301380,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:43.813755+0000","last_change":"2024-09-17T16:42:43.813755+0000","last_active":"2024-09-17T16:42:43.813755+0000","last_peered":"2024-09-17T16:42:43.813755+0000","last_clean":"2024-09-17T16:42:43.813755+0000","last_became_active":"2024-09-17T16:35:23.132603+0000","last_became_peered":"2024-09-17T16:35:23.132603+0000","last_unstale":"2024-09-17T16:42:43.813755+0000","last_undegraded":"2024-09-17T16:42:43.813755+0000","last_fullsized":"2024-09-17T16:42:43.813755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4726","last_scrub_stamp":"2024-09-17T16:42:43.813639+0000","last_deep_scrub":"19'4726","last_deep_scrub_stamp":"2024-09-17T16:42:43.813639+0000","last_clean_scrub_stamp":"2024-09-17T16:42:43.813639+0000","objects_scrubbed":278,"log_size":4726,"log_dups_size":0,"ondisk_log_size":4726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:03:45.910420+0000","scrub_duration":1355,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291504128,"num_objects":278,"num_object_clones":0,"num_object_copies":834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":278,"num_whiteouts":0,"num_read":296609,"num_read_kb":18982976,"num_write":4448,"num_write_kb":284672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,1],"acting":[5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:40.466915+0000","last_change":"2024-09-17T16:42:40.466915+0000","last_active":"2024-09-17T16:42:40.466915+0000","last_peered":"2024-09-17T16:42:40.466915+0000","last_clean":"2024-09-17T16:42:40.466915+0000","last_became_active":"2024-09-17T16:35:14.065746+0000","last_became_peered":"2024-09-17T16:35:14.065746+0000","last_unstale":"2024-09-17T16:42:40.466915+0000","last_undegraded":"2024-09-17T16:42:40.466915+0000","last_fullsized":"2024-09-17T16:42:40.466915+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:40.466846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:40.466846+0000","last_clean_scrub_stamp":"2024-09-17T16:42:40.466846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:35:30.420756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038337499999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"19'4896","reported_seq":311610,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:44.660508+0000","last_change":"2024-09-17T16:42:44.660508+0000","last_active":"2024-09-17T16:42:44.660508+0000","last_peered":"2024-09-17T16:42:44.660508+0000","last_clean":"2024-09-17T16:42:44.660508+0000","last_became_active":"2024-09-17T16:35:23.134260+0000","last_became_peered":"2024-09-17T16:35:23.134260+0000","last_unstale":"2024-09-17T16:42:44.660508+0000","last_undegraded":"2024-09-17T16:42:44.660508+0000","last_fullsized":"2024-09-17T16:42:44.660508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4896","last_scrub_stamp":"2024-09-17T16:42:44.660389+0000","last_deep_scrub":"19'4896","last_deep_scrub_stamp":"2024-09-17T16:42:44.660389+0000","last_clean_scrub_stamp":"2024-09-17T16:42:44.660389+0000","objects_scrubbed":288,"log_size":4896,"log_dups_size":0,"ondisk_log_size":4896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:35:54.899772+0000","scrub_duration":1237,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":301989888,"num_objects":288,"num_object_clones":0,"num_object_copies":864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":306669,"num_read_kb":19626816,"num_write":4608,"num_write_kb":294912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"19'3","reported_seq":42,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:39.983460+0000","last_change":"2024-09-17T16:42:39.983460+0000","last_active":"2024-09-17T16:42:39.983460+0000","last_peered":"2024-09-17T16:42:39.983460+0000","last_clean":"2024-09-17T16:42:39.983460+0000","last_became_active":"2024-09-17T16:35:14.065650+0000","last_became_peered":"2024-09-17T16:35:14.065650+0000","last_unstale":"2024-09-17T16:42:39.983460+0000","last_undegraded":"2024-09-17T16:42:39.983460+0000","last_fullsized":"2024-09-17T16:42:39.983460+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'3","last_scrub_stamp":"2024-09-17T16:42:39.983353+0000","last_deep_scrub":"19'3","last_deep_scrub_stamp":"2024-09-17T16:42:39.983353+0000","last_clean_scrub_stamp":"2024-09-17T16:42:39.983353+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:18:07.966558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000933667,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"19'5338","reported_seq":339602,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:39.677211+0000","last_change":"2024-09-17T16:42:39.677211+0000","last_active":"2024-09-17T16:42:39.677211+0000","last_peered":"2024-09-17T16:42:39.677211+0000","last_clean":"2024-09-17T16:42:39.677211+0000","last_became_active":"2024-09-17T16:35:23.133244+0000","last_became_peered":"2024-09-17T16:35:23.133244+0000","last_unstale":"2024-09-17T16:42:39.677211+0000","last_undegraded":"2024-09-17T16:42:39.677211+0000","last_fullsized":"2024-09-17T16:42:39.677211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5338","last_scrub_stamp":"2024-09-17T16:42:39.677123+0000","last_deep_scrub":"19'5338","last_deep_scrub_stamp":"2024-09-17T16:42:39.677123+0000","last_clean_scrub_stamp":"2024-09-17T16:42:39.677123+0000","objects_scrubbed":314,"log_size":5338,"log_dups_size":0,"ondisk_log_size":5338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:35:31.126903+0000","scrub_duration":1097,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329252864,"num_objects":314,"num_object_clones":0,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":334218,"num_read_kb":21389952,"num_write":5024,"num_write_kb":321536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"19'2","reported_seq":41,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.706007+0000","last_change":"2024-09-17T16:42:38.706007+0000","last_active":"2024-09-17T16:42:38.706007+0000","last_peered":"2024-09-17T16:42:38.706007+0000","last_clean":"2024-09-17T16:42:38.706007+0000","last_became_active":"2024-09-17T16:35:13.497657+0000","last_became_peered":"2024-09-17T16:35:13.497657+0000","last_unstale":"2024-09-17T16:42:38.706007+0000","last_undegraded":"2024-09-17T16:42:38.706007+0000","last_fullsized":"2024-09-17T16:42:38.706007+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'2","last_scrub_stamp":"2024-09-17T16:42:38.705935+0000","last_deep_scrub":"19'2","last_deep_scrub_stamp":"2024-09-17T16:42:38.705935+0000","last_clean_scrub_stamp":"2024-09-17T16:42:38.705935+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:46:58.036940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00034153500000000002,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"19'4981","reported_seq":316590,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.594389+0000","last_change":"2024-09-17T16:42:42.594389+0000","last_active":"2024-09-17T16:42:42.594389+0000","last_peered":"2024-09-17T16:42:42.594389+0000","last_clean":"2024-09-17T16:42:42.594389+0000","last_became_active":"2024-09-17T16:35:23.134320+0000","last_became_peered":"2024-09-17T16:35:23.134320+0000","last_unstale":"2024-09-17T16:42:42.594389+0000","last_undegraded":"2024-09-17T16:42:42.594389+0000","last_fullsized":"2024-09-17T16:42:42.594389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4981","last_scrub_stamp":"2024-09-17T16:42:42.594266+0000","last_deep_scrub":"19'4981","last_deep_scrub_stamp":"2024-09-17T16:42:42.594266+0000","last_clean_scrub_stamp":"2024-09-17T16:42:42.594266+0000","objects_scrubbed":293,"log_size":4981,"log_dups_size":0,"ondisk_log_size":4981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:27:22.110503+0000","scrub_duration":1112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":307232768,"num_objects":293,"num_object_clones":0,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":293,"num_whiteouts":0,"num_read":311564,"num_read_kb":19940096,"num_write":4688,"num_write_kb":300032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'4573","reported_seq":291888,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:44.743182+0000","last_change":"2024-09-17T16:42:44.743182+0000","last_active":"2024-09-17T16:42:44.743182+0000","last_peered":"2024-09-17T16:42:44.743182+0000","last_clean":"2024-09-17T16:42:44.743182+0000","last_became_active":"2024-09-17T16:35:23.137488+0000","last_became_peered":"2024-09-17T16:35:23.137488+0000","last_unstale":"2024-09-17T16:42:44.743182+0000","last_undegraded":"2024-09-17T16:42:44.743182+0000","last_fullsized":"2024-09-17T16:42:44.743182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4573","last_scrub_stamp":"2024-09-17T16:42:44.743086+0000","last_deep_scrub":"19'4573","last_deep_scrub_stamp":"2024-09-17T16:42:44.743086+0000","last_clean_scrub_stamp":"2024-09-17T16:42:44.743086+0000","objects_scrubbed":269,"log_size":4573,"log_dups_size":0,"ondisk_log_size":4573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:59:35.182069+0000","scrub_duration":1264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":282066944,"num_objects":269,"num_object_clones":0,"num_object_copies":807,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":269,"num_whiteouts":0,"num_read":287272,"num_read_kb":18385408,"num_write":4304,"num_write_kb":275456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:39.740313+0000","last_change":"2024-09-17T16:42:39.740313+0000","last_active":"2024-09-17T16:42:39.740313+0000","last_peered":"2024-09-17T16:42:39.740313+0000","last_clean":"2024-09-17T16:42:39.740313+0000","last_became_active":"2024-09-17T16:35:13.496006+0000","last_became_peered":"2024-09-17T16:35:13.496006+0000","last_unstale":"2024-09-17T16:42:39.740313+0000","last_undegraded":"2024-09-17T16:42:39.740313+0000","last_fullsized":"2024-09-17T16:42:39.740313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:39.740231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:39.740231+0000","last_clean_scrub_stamp":"2024-09-17T16:42:39.740231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:46:06.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000358735,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"19'5219","reported_seq":376955,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:43.031122+0000","last_change":"2024-09-17T16:42:43.031122+0000","last_active":"2024-09-17T16:42:43.031122+0000","last_peered":"2024-09-17T16:42:43.031122+0000","last_clean":"2024-09-17T16:42:43.031122+0000","last_became_active":"2024-09-17T16:35:23.138201+0000","last_became_peered":"2024-09-17T16:35:23.138201+0000","last_unstale":"2024-09-17T16:42:43.031122+0000","last_undegraded":"2024-09-17T16:42:43.031122+0000","last_fullsized":"2024-09-17T16:42:43.031122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'5219","last_scrub_stamp":"2024-09-17T16:42:43.030990+0000","last_deep_scrub":"19'5219","last_deep_scrub_stamp":"2024-09-17T16:42:43.030990+0000","last_clean_scrub_stamp":"2024-09-17T16:42:43.030990+0000","objects_scrubbed":307,"log_size":5219,"log_dups_size":0,"ondisk_log_size":5219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:53:52.662672+0000","scrub_duration":1302,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":321912832,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":307,"num_whiteouts":0,"num_read":327425,"num_read_kb":20955200,"num_write":4912,"num_write_kb":314368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6380,"num_bytes_recovered":6689914880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":6380},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":39,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:40.977040+0000","last_change":"2024-09-17T16:42:40.977040+0000","last_active":"2024-09-17T16:42:40.977040+0000","last_peered":"2024-09-17T16:42:40.977040+0000","last_clean":"2024-09-17T16:42:40.977040+0000","last_became_active":"2024-09-17T16:35:14.134117+0000","last_became_peered":"2024-09-17T16:35:14.134117+0000","last_unstale":"2024-09-17T16:42:40.977040+0000","last_undegraded":"2024-09-17T16:42:40.977040+0000","last_fullsized":"2024-09-17T16:42:40.977040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:40.976955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:40.976955+0000","last_clean_scrub_stamp":"2024-09-17T16:42:40.976955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:20:54.956376+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00044059299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"19'4488","reported_seq":285969,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:43.677391+0000","last_change":"2024-09-17T16:42:43.677391+0000","last_active":"2024-09-17T16:42:43.677391+0000","last_peered":"2024-09-17T16:42:43.677391+0000","last_clean":"2024-09-17T16:42:43.677391+0000","last_became_active":"2024-09-17T16:35:23.137624+0000","last_became_peered":"2024-09-17T16:35:23.137624+0000","last_unstale":"2024-09-17T16:42:43.677391+0000","last_undegraded":"2024-09-17T16:42:43.677391+0000","last_fullsized":"2024-09-17T16:42:43.677391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4488","last_scrub_stamp":"2024-09-17T16:42:43.677288+0000","last_deep_scrub":"19'4488","last_deep_scrub_stamp":"2024-09-17T16:42:43.677288+0000","last_clean_scrub_stamp":"2024-09-17T16:42:43.677288+0000","objects_scrubbed":264,"log_size":4488,"log_dups_size":0,"ondisk_log_size":4488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:43:51.448434+0000","scrub_duration":1192,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":276824064,"num_objects":264,"num_object_clones":0,"num_object_copies":792,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":281437,"num_read_kb":18011968,"num_write":4224,"num_write_kb":270336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":39,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:40.473819+0000","last_change":"2024-09-17T16:42:40.473819+0000","last_active":"2024-09-17T16:42:40.473819+0000","last_peered":"2024-09-17T16:42:40.473819+0000","last_clean":"2024-09-17T16:42:40.473819+0000","last_became_active":"2024-09-17T16:35:14.065678+0000","last_became_peered":"2024-09-17T16:35:14.065678+0000","last_unstale":"2024-09-17T16:42:40.473819+0000","last_undegraded":"2024-09-17T16:42:40.473819+0000","last_fullsized":"2024-09-17T16:42:40.473819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:40.473763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:40.473763+0000","last_clean_scrub_stamp":"2024-09-17T16:42:40.473763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:25:28.349303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041479400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.417869+0000","last_change":"2024-09-17T16:42:41.417869+0000","last_active":"2024-09-17T16:42:41.417869+0000","last_peered":"2024-09-17T16:42:41.417869+0000","last_clean":"2024-09-17T16:42:41.417869+0000","last_became_active":"2024-09-17T16:35:14.134094+0000","last_became_peered":"2024-09-17T16:35:14.134094+0000","last_unstale":"2024-09-17T16:42:41.417869+0000","last_undegraded":"2024-09-17T16:42:41.417869+0000","last_fullsized":"2024-09-17T16:42:41.417869+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:41.417785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:41.417785+0000","last_clean_scrub_stamp":"2024-09-17T16:42:41.417785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:03:35.463103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037500100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"19'4267","reported_seq":311360,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.644154+0000","last_change":"2024-09-17T16:42:41.644154+0000","last_active":"2024-09-17T16:42:41.644154+0000","last_peered":"2024-09-17T16:42:41.644154+0000","last_clean":"2024-09-17T16:42:41.644154+0000","last_became_active":"2024-09-17T16:35:23.137988+0000","last_became_peered":"2024-09-17T16:35:23.137988+0000","last_unstale":"2024-09-17T16:42:41.644154+0000","last_undegraded":"2024-09-17T16:42:41.644154+0000","last_fullsized":"2024-09-17T16:42:41.644154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'4267","last_scrub_stamp":"2024-09-17T16:42:41.644042+0000","last_deep_scrub":"19'4267","last_deep_scrub_stamp":"2024-09-17T16:42:41.644042+0000","last_clean_scrub_stamp":"2024-09-17T16:42:41.644042+0000","objects_scrubbed":251,"log_size":4267,"log_dups_size":0,"ondisk_log_size":4267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:49:38.199439+0000","scrub_duration":912,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263192576,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":251,"num_whiteouts":0,"num_read":268275,"num_read_kb":17169600,"num_write":4016,"num_write_kb":257024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5571,"num_bytes_recovered":5841616896,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":5571},"up":[1,0,4],"acting":[1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":4787732504,"num_objects":4567,"num_object_clones":0,"num_object_copies":13701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4567,"num_whiteouts":0,"num_read":4869998,"num_read_kb":311679809,"num_write":73056,"num_write_kb":4675521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30594,"num_bytes_recovered":32080134144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":30594},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":897712128,"data_stored":14363197512,"data_compressed":682038132,"data_compressed_allocated":897699840,"data_compressed_original":14363197440,"omap_allocated":0,"internal_metadata":0},"log_size":77623,"ondisk_log_size":77623,"up":48,"acting":48,"num_store_stats":6},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640351,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142956,"kb_used_data":89564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94228884,"statfs":{"total":96636764160,"available":96490377216,"internally_reserved":0,"allocated":91713536,"data_stored":1464847463,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640352,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237172,"kb_used_data":143588,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94134668,"statfs":{"total":96636764160,"available":96393900032,"internally_reserved":0,"allocated":147034112,"data_stored":2349911162,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640352,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":264048,"kb_used_data":182880,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94107792,"statfs":{"total":96636764160,"available":96366379008,"internally_reserved":0,"allocated":187269120,"data_stored":2993671295,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":1593,"internal_metadata":83098055},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640352,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":181428,"kb_used_data":110052,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94190412,"statfs":{"total":96636764160,"available":96450981888,"internally_reserved":0,"allocated":112693248,"data_stored":1800457343,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640351,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":452148,"kb_used_data":168356,"kb_used_omap":1,"kb_used_meta":283774,"kb_avail":93919692,"statfs":{"total":96636764160,"available":96173764608,"internally_reserved":0,"allocated":172396544,"data_stored":2755710079,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":1595,"internal_metadata":290585029},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":30594,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640352,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268528,"kb_used_data":183200,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94103312,"statfs":{"total":96636764160,"available":96361791488,"internally_reserved":0,"allocated":187596800,"data_stored":2998914170,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":187428864,"data_stored":2998861824,"data_compressed":142401324,"data_compressed_allocated":187428864,"data_compressed_original":2998861824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172232704,"data_stored":2755657752,"data_compressed":130852692,"data_compressed_allocated":172228608,"data_compressed_original":2755657728,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":112529408,"data_stored":1800405016,"data_compressed":85492496,"data_compressed_allocated":112525312,"data_compressed_original":1800404992,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187105280,"data_stored":2993618968,"data_compressed":142152359,"data_compressed_allocated":187101184,"data_compressed_original":2993618944,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":146866176,"data_stored":2349858816,"data_compressed":111583315,"data_compressed_allocated":146866176,"data_compressed_original":2349858816,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":91549696,"data_stored":1464795136,"data_compressed":69555946,"data_compressed_allocated":91549696,"data_compressed_original":1464795136,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:43:00.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T16:43:01.060 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T16:43:01.061 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T16:43:01.061 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T16:43:01.061 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.095 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T16:43:01.095 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.184 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T16:43:01.185 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T16:43:01.185 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.230 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T16:43:01.231 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T16:43:01.231 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.279 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T16:43:01.279 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T16:43:01.279 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.320 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T16:43:01.320 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T16:43:01.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.394 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T16:43:01.395 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T16:43:01.395 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T16:43:01.395 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.423 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T16:43:01.423 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T16:43:01.423 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T16:43:01.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:43:01.474 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T16:43:01.474 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T16:43:01.474 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'missing primary copy of' | egrep -v 'objects unfound and apparently lost' | egrep -v 'had a read error' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(OSD_TOO_MANY_REPAIRS\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-09-17T16:43:01.577 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:43:01.577 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T16:43:02.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:43:02.386 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T16:43:02.567 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T16:43:02.567 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T16:43:02.624 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:43:02.624 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T16:43:04.797 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:43:04.797 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T16:43:04.885 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T16:43:04.885 DEBUG:teuthology.orchestra.run.smithi165:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T16:43:04.940 INFO:tasks.ceph:Archiving mon data... 2024-09-17T16:43:04.941 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077/data/mon.a.tgz 2024-09-17T16:43:04.942 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.uhuaGHAkri 2024-09-17T16:43:04.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uhuaGHAkri 2024-09-17T16:43:05.387 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.uhuaGHAkri 2024-09-17T16:43:05.489 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.uhuaGHAkri is 2MB 2024-09-17T16:43:05.587 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.uhuaGHAkri 2024-09-17T16:43:05.603 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T16:43:05.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T16:43:05.645 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T16:43:05.723 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T16:43:05.740 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T16:43:05.740 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T16:43:05.742 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077/remote/smithi138/crash 2024-09-17T16:43:05.743 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T16:43:05.788 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077/remote/smithi165/crash 2024-09-17T16:43:05.789 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T16:43:05.834 INFO:tasks.ceph:Compressing logs... 2024-09-17T16:43:05.835 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T16:43:05.838 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T16:43:05.859 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T16:43:05.859 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34813.log 2024-09-17T16:43:05.859 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36056.log 2024-09-17T16:43:05.882 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31206.log 2024-09-17T16:43:05.882 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31286.log 2024-09-17T16:43:05.882 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34207.log 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31206.log.gz 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34123.log 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31286.log.gz 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31246.log 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34207.log.gz 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31166.log 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34123.log.gz 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31366.log 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31246.log.gz 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31166.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31166.log.gz 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34249.log 2024-09-17T16:43:05.883 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31366.log.gz 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34165.log 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34249.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34249.log.gz 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34272.log 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34165.log.gz 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31326.log 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.34272.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.0.34272.log.gz 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr: --verbose -- /var/log/ceph/ceph-client.0.34310.log 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.31326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31326.log.gz 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.0.34310.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34310.log.gz 2024-09-17T16:43:05.884 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-client.admin.34383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-09-17T16:43:05.887 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35650.log 2024-09-17T16:43:05.887 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34813.log.gz 2024-09-17T16:43:05.887 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35251.log 2024-09-17T16:43:05.887 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36056.log.gz 2024-09-17T16:43:05.887 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35737.log 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35650.log.gz 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35251.log.gz 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35821.log 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35737.log.gz 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35292.log 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35821.log.gz 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35964.log 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35292.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.35292.log.gz -- 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr: /var/log/ceph/ceph-client.admin.36142.log 2024-09-17T16:43:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35293.log 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35964.log.gz 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35081.log 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36142.log.gz 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35545.log 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35293.log.gz 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr:gzip/var/log/ceph/ceph-client.admin.35081.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36521.log 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35081.log.gz 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35545.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35545.log.gz 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35076.log 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36521.log.gz 2024-09-17T16:43:05.889 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35372.log 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35076.log.gz 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36227.log 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35372.log.gz 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34939.log 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35079.log 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36227.log.gz 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35649.log 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34939.log.gz 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2024-09-17T16:43:05.890 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35079.log.gz 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36479.log 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35649.log.gz 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31667.log 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36184.log 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36479.log.gz 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.31667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34855.log 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31667.log.gz 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31926.log 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35373.log 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34855.log.gz 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.31926.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T16:43:05.891 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31926.log.gz 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34897.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35373.log.gz 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35922.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36645.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34897.log.gz 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35080.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35922.log.gz 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36645.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36645.log.gz 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34681.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35080.log.gz 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31857.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35651.log 2024-09-17T16:43:05.892 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34681.log.gz 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.31857.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31857.log.gz 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35651.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35651.log.gz 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31570.log 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36563.log 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.31570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31570.log.gz 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36437.log 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36563.log.gz 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35078.log 0.0% 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35879.log 2024-09-17T16:43:05.893 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36437.log.gz 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35253.log 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35078.log.gz 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35879.log.gz 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36006.log 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36353.log 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35253.log.gz 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36006.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27242.log 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36006.log.gz 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36353.log.gz 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.tmp-client.admin.27242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-09-17T16:43:05.894 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27242.log.gz 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36311.log 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35485.log 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36605.log 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36311.log.gz 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.35485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34762.log 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35485.log.gz 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36395.log 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36605.log.gz 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34762.log.gz 2024-09-17T16:43:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.36395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36395.log.gz 2024-09-17T16:43:05.896 INFO:teuthology.orchestra.run.smithi138.stderr: 87.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T16:43:06.343 INFO:teuthology.orchestra.run.smithi138.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T16:43:08.525 INFO:teuthology.orchestra.run.smithi138.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T16:44:18.476 INFO:teuthology.orchestra.run.smithi138.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T16:46:32.297 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/ceph-osd.3.log: 94.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T16:48:13.446 INFO:teuthology.orchestra.run.smithi165.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T16:50:07.334 INFO:teuthology.orchestra.run.smithi165.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T16:50:07.336 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-17T16:50:07.336 INFO:teuthology.orchestra.run.smithi165.stderr:real 7m1.481s 2024-09-17T16:50:07.336 INFO:teuthology.orchestra.run.smithi165.stderr:user 4m45.245s 2024-09-17T16:50:07.336 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m13.269s 2024-09-17T16:58:16.737 INFO:teuthology.orchestra.run.smithi138.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T17:00:47.187 INFO:teuthology.orchestra.run.smithi138.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T17:00:47.189 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-17T17:00:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:real 17m41.339s 2024-09-17T17:00:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:user 6m25.019s 2024-09-17T17:00:47.189 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m19.853s 2024-09-17T17:00:47.190 INFO:tasks.ceph:Archiving logs... 2024-09-17T17:00:47.191 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077/remote/smithi138/log 2024-09-17T17:00:47.192 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T17:01:44.070 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077/remote/smithi165/log 2024-09-17T17:01:44.072 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T17:02:26.300 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T17:02:26.310 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T17:02:26.311 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T17:02:26.314 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T17:02:26.482 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T17:02:26.491 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T17:02:26.491 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T17:02:26.494 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T17:02:26.508 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-17T17:02:26.511 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-17T17:02:26.537 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T17:02:26.537 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-17T17:02:26.537 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 57 +319us[ +319us] +/- 65ms 2024-09-17T17:02:26.537 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 +165us[ +163us] +/- 53ms 2024-09-17T17:02:26.537 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -672us[ -672us] +/- 75ms 2024-09-17T17:02:26.537 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T17:02:26.543 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T17:02:26.543 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-17T17:02:26.544 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 57 +346us[ +360us] +/- 65ms 2024-09-17T17:02:26.544 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 +191us[ +205us] +/- 53ms 2024-09-17T17:02:26.544 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -654us[ -654us] +/- 75ms 2024-09-17T17:02:26.544 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T17:02:26.545 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T17:02:26.553 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T17:02:26.553 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T17:02:26.564 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T17:02:26.685 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T17:02:26.773 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T17:02:26.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T17:02:26.804 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T17:02:26.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T17:02:26.837 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T17:02:26.847 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T17:02:26.856 INFO:teuthology.task.internal:Duration was 2037.047708 seconds 2024-09-17T17:02:26.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T17:02:26.866 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T17:02:26.866 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T17:02:26.868 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T17:02:26.916 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T17:02:26.939 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T17:02:27.327 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T17:02:27.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-17T17:02:27.328 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T17:02:27.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-17T17:02:27.349 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T17:02:27.384 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T17:02:27.384 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T17:02:27.391 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T17:02:27.452 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T17:02:27.453 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T17:02:27.457 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T17:02:27.600 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T17:02:27.609 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T17:02:27.610 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T17:02:27.635 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T17:02:27.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T17:02:27.671 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T17:02:27.677 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T17:02:27.707 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-17T17:02:27.735 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-17T17:02:27.767 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T17:02:27.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T17:02:27.782 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T17:02:27.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T17:02:27.822 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T17:02:27.832 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T17:02:27.833 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077/remote/smithi138 2024-09-17T17:02:27.833 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T17:02:27.868 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909077/remote/smithi165 2024-09-17T17:02:27.869 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T17:02:27.903 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T17:02:27.903 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T17:02:27.905 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T17:02:27.953 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T17:02:27.964 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T17:02:27.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T17:02:28.019 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T17:02:28.020 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T17:02:28.022 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T17:02:28.035 INFO:teuthology.orchestra.run.smithi138.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 17:02 /home/ubuntu/cephtest 2024-09-17T17:02:28.037 INFO:teuthology.orchestra.run.smithi165.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 17:02 /home/ubuntu/cephtest 2024-09-17T17:02:28.038 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T17:02:28.057 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T17:02:28.086 INFO:teuthology.run:Summary data: description: rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/{bluestore-options/write$/{write_random} bluestore/bluestore-comp-snappy} rados supported-random-distro$/{centos_latest}} duration: 2037.0477075576782 flavor: default owner: scheduled_skanta@teuthology success: true 2024-09-17T17:02:28.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T17:02:28.163 INFO:teuthology.run:pass